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1.  Introduction 


This  report  summarizes  our  collective  thoughts  on  the  state  of  the  art  in  reaching  through 
randomly  scattering  media  with  light  and  the  opportunities  at  this  time  for  substantial  impact.  The  topics 
covered  and  the  references  cited  are  representative  but  not  exhaustive. 

Section  2  describes  established  understanding  methods.  Section  3  presents  opportunities  that  stem 
from  recent  progress  and  will  applications  in  new  scatter  regimes,  thereby  approaching  the  physical  limits 
presented.  Conclusions  are  presented  in  Section  4.  Section  5,  the  Acknowledgement,  thanks  those  who 
contributed  to  a  workshop  held  to  discuss  this  field.  References  are  provided  in  Section  6. 


2.  Established  Concepts  Related  to  Scattering  Media 

2.1.  Introduction  -  Light  in  Scattering  Media 

Light  is  of  key  importance  in  artistic,  scientific,  medical,  industrial,  and  defense  settings  because 
of  spectroscopy,  information  capacity,  and  the  advanced  state  of  source  and  detector  technology.  The 
manipulation  of  light  has  evolved  from  the  bronze  mirrors  of  the  ancient  Pharos  of  Alexandria  to  today’s 
optical  imaging  systems  that  gather  a  wealth  of  information  about  our  environment,  our  health,  and  our 
universe.  Optical  lithography  systems  create  the  essential  components  of  our  computers  and  smartphones, 
which  themselves  contain  ever  more  advanced  optical  systems  that  acquire  and  represent  information  for 
the  user.  The  almost  lossless  propagation  through  transparent  media  such  as  air,  glass  and  optical  fiber 
makes  light  an  excellent  carrier  of  information  [Gabl946,  Clal962,  Penl983,  Bar2008].  However,  it 
remains  a  challenge  to  retrieve  information  from  inside  turbid  materials,  such  as  paint,  paper  and 
biological  tissue  [Ishl978,  Seb2001,  Tuc2007,  Wan2007a,  Pop2010b,  Boa2012,  Wie2013].  In  such 
materials,  light  is  scattered  and  the  information  is  scrambled.  Moreover,  materials  such  as  biological 
tissue  are  frequently  absorbing.  Both  absorption  and  scattering  extinguish  the  “ballistic”  (straight- 
propagating)  light,  and  the  information  it  contains,  exponentially  with  depth.  However,  the  presence  of 
scatter  can  also  increase  communication  capacity  because  of  the  presence  of  multiple,  independent 
channels  [Mou2000]  and  provide  security  [Pap2002] .  The  challenge  is  to  decipher  the  scattered  light,  or 
conversely,  to  be  able  to  control  light,  and  to  achieve  adequate  signal  to  noise  at  the  detectors. 

Many  imaging  methods  have  been  developed  for  use  in  turbid  materials.  Typically  they  work  by 
discerning  two  contributions  to  the  detected  light:  First,  ballistic  light  that  has  propagated  in  a  straight  line 
from  the  lens  system  to  the  object  or  vice  versa,  and  second,  scattered  light  whose  direction  has  been 
changed  by  scattering  one  or  more  times  along  the  way.  The  ballistic  light  carries  a  very  high  density  of 
information  and  can  be  used  to  make  a  wavelength-resolution  image  of  the  object,  provided  that  the 
scattered  light  is  rejected.  As  the  intensity  of  ballistic  light  decays  exponentially  with  distance  in  a 
scattering  medium,  the  signal  is  insufficient  to  retrieve  an  image  already  at  moderate  depth. 

High-resolution  imaging  at  shallow  depth  is  the  domain  of  multiphoton  imaging  [Hel2005], 
which  has  recently  reached  depths  of  about  1  mm  in  mouse  brain  tissue,  paired  with  sub-micron 
resolution  [Hor2013].  Multiphoton  methods  exploit  the  fact  that  the  intensity  of  a  ballistic  optical  focus 
exceeds  that  of  scattered  light  even  at  depths  of  several  scattering  mean  free  paths  (Box  1).  By  correcting 
aberrations  in  the  optical  path  with  adaptive  optics  techniques,  high-resolution  imaging  can  be  extended 
to  the  limiting  depth  of  the  method  [Rue2006,  Ant2014].  Rapid  and  label-free  imaging  at  moderate  depth 
is  accomplished  by  gated  imaging  methods  [Abrl978],  such  as  optical  coherence  tomography  (OCT) 
[Hual991].  Gated  imaging  methods  selectively  detect  ballistic  light  by  measuring  the  travel  time  of  the 
light  pulses  with  sub-ps  accuracy  [Wanl991].  OCT  offers  excellent  sub-^rm  resolution  [Dre2001]  and 
high  speed  [Nas2004].  However,  as  scatter  increases,  diffuse  light  overwhelms  the  signal,  and  methods 
such  as  OCT  fail.  An  exciting  development  is  the  use  of  wavefront  shaping  paired  with  OCT  to  reach 
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better  image  quality  and  possibly  increased  depth  in  a  scattering  medium  [Fio2012,  Jan2013].  New 
developments  in  ultrafast  imaging  have  given  rise  to  time-gated  methods  that  can  capture  ultrafast  images 
from  wall  reflections  and  potentially  inside  scattering  media  [Gup2012,  Nai2014].  All  of  these  methods 
face  challenges  reaching  beyond  one  transport  mean  free  path  (/*)  or  thereabouts. 


Box  1:  Light  in  turbid  materials. 

When  laser  light  impinges  on  a  complex  material  such  as  paper,  paint  or 
skin,  it  is  scattered  by  nanoscale  inhomogeneities  such  as  the  fibers  in 
paper,  the  pigment  particles  in  paint  and  the  cells  in  skin.  Light  transmitted 
through  these  materials  typically  follows  a  long  and  convoluted  path 
incorporating  multiple  scattering  events,  as  depicted  in  panel  (a).  A  small 
fraction  of  the  incident  light  continues  on  a  straight  path.  The  intensity  of 
this  “ballistic”  light  decays  exponentially  with  depth,  to  a  very  good 
approximation  [Pop2000]  following  the  Beer-Lambert  law, 

I  (z)  =  I0e~^,  (1) 

where  7(z)  is  the  intensity  of  ballistic  light  at  depth  z,  and  £  is  the 
scattering  mean  free  path  (also  known  as  attenuation  length  or  inverse 
scattering  coefficient).  Small  angle  scattering  perturbs  the  flow  of  light  less 
than  large  angle  scattering.  The  transport  mean  free  path  (also  known  as 
momentum  correlation  length  or  inverse  reduced  scattering  coefficient  for 
lossless  media)  expresses  the  length  over  which  the  angle  is  completely 
randomized,  and  thereby  accounts  for  the  average  scattering  angle 
[Akk2007,  Ntz2010,  Boa2012,  Sve2013]. 

As  scattering  in  a  solid  sample  does  not  perturb  the  phase  coherence  of 
the  light,  scattered  waves  that  arrive  by  ‘different  paths’  through  the  sample 
show  interference.  Depending  on  the  detailed  positions  of  the  random 
scatterers,  this  interference  is  constructive  at  some  positions  and  destructive 
at  others.  The  result  is  a  characteristic  pattern  of  dark  and  light  spots  known 
as  laser  speckle,  shown  in  (b).  This  pattern  is  stable  as  long  as  the  scatterers 
inside  the  sample  do  not  move  and  the  illumination  is  stable.  The  average 
size  of  a  speckle  spot  is  determined  by  the  geometry  of  the  experiment. 

The  Van  Cittert-Zernike  theorem  [Citl934,  Zerl938,  Dail975, 
Goo2007]  shows  that  it  is  similar  to  the  size  of  the  focus  of  an  ideal  lens  of 
the  same  size  and  distance  as  the  random  medium.  The  total  number  of 
spots  is  approximately  equal  to  the  number  of  degrees  of  freedom  (modes) 
of  the  wavefront. 

The  phase  of  the  light  is  coherent  over  an  area  comparable  to  a  typical 
speckle  spot  as  shown  in  panel  (c),  hence  the  area  of  a  speckle  spot  is  often 
indicated  as  a  mode  or  a  coherence  area.  Many  subtle  correlations  can  be 
found  in  speckle  patterns  [Fenl988,  Seb2001,  Bir2010,  Akk2007],  and 
have  been  exploited  for  imaging  [Frel990,  Put2011,  Put2012,  Ber2012, 
Gjo2013,  Vel2012,  Hsi2010,  Kat2014a,  Yan2014], 


a)  Cartoon  of  the  light  paths 
through  a  strongly  scattering 
medium.  Most  light  is 
backscattered  in  the  surface  layer. 


b)  Intensity  pattern  of  speckle 
transmitted  through  a  strongly 
scattering  sample  [Akb2013]. 
True  size  10  xlO  pm. 


c)  Impression  of  the  phase  pattern 
corresponding  to  (b). 


In  domains  like  tissue,  turbid  water,  snow,  and  aerosols,  light  is  scattered  and  the  information  is 
scrambled.  With  enough  signal  to  noise,  diffusely  scattered  light  can  be  used  to  pinpoint  the  position  of  a 
small  absorber  or  source  with  pm  precision  [Outl993],  and  even  recover  the  shape  of  an  embedded  object 
in  a  collection  of  methods  known  as  diffuse  optical  tomography  (DOT)  or  optical  diffusion  tomography 
(ODT)  [Yodl995,  Reyl996,  Yel999a,  Yel999b,  Ye2001,  Mil2002,  Oh2002,  Mil2004,  Gib2005, 
Mil2005b,  Oh2005,  Dur2010,  Che2000,  Dam2011,  Tur2005,  Ntz2006,  Zac2006].  The  resolution  has  been 
improved  by  combining  DOT  with  X-ray  or  ultrasound  tomography  [Dur2010].  However,  these 
techniques  do  not  take  direct  advantage  of  the  coherent  nature  of  scattered  light.  Coherence  plays  an 
essential  role  in  recent  work  applying  wavefront  shaping  and  guidestars  to  undo  scattering,  opening 
prospects  for  wavelength-scale  resolution  through  substantial  scatter. 
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2.2.  Speckle  -  Coherent  Light  in  Random  Media 


When  coherent  light  is  transmitted  through  a  random  medium,  the  multiple  paths  available  for 
light  propagation  give  rise  to  mutual  interference  and  a  non-uniform  granular  light  intensity  profile  on  the 
exit  face.  The  mottled  appearance  of  the  transmitted  light  field  is  called  a  speckle  light  field  (Box  1). 
Speckle  has  been  exploited  in  many  subtle  ways.  See,  for  example  [Fenl988,  Seb2001,  Bir2010, 
Akk2007Frel990,  Put2011,  Put2012,  Ber2012,  Gjo2013,  Vel2012,  Hsi2010,  Kat2014a,  Yan2014],  After 
significant  scattering  of  approximately  monochromatic  light,  and  with  weakly  interacting  scatterers,  the 
central  limit  theorem  may  define  the  resulting  complex  field  as  a  summation  of  many  random  phasors.  A 
measurement  of  polarized  light  then  produces  a  zero  mean  circular  Gaussian  density  function.  We  refer  to 
this  type  of  random  optical  field  as  a  “fully  developed”  speckle  pattern.  On  a  discretized  spatial  grid,  we 
may  therefore  define  a  fully  developed  speckle  pattern  using  a  circularly  complex,  Gaussian  random 
variable  with  zero  mean  at  each  grid  location.  In  this  case,  we  can  show  that  the  intensity  statistics 
corresponding  follow  a  negative  exponential  distribution  [Web2004] 


The  amplitude  and  phase  of  the  scattered  light  is  correlated  over  an  area  comparable  to  that  of  a 
typical  speckle  spot,  and  the  size  can  be  characterized  by  the  autocorrelation  of  the  speckle  intensity 
pattern.  While  speckle  can  be  imaged  and  the  size  can  be  controlled  by  the  imaging  optics  [Web2000, 
Wan2006],  without  such  steps  and  with  a  speckled  field  over  a  large  spatial  support  at  the  scattering 
medium  surface  or  within  the  medium,  the  smallest  speckle  spot  is  about  k/2  in  diameter,  where  /,  is  the 
wavelength  of  the  light  source.  When  the  scatterer’s  back  surface  is  separated  by  a  distance  d  from  the 
plane  where  the  speckle  is  viewed,  then  the  average  speckle  diameter  s  takes  the  approximate  value 
s  =  Xd/w ,  where  w  is  the  diameter  of  the  scatterer’s  back  surface.  Thus  the  average  speckle  size 
increases  linearly  with  propagation  distance  d  and  decreases  with  the  scattering  area.  The  speckle 
granularity  is  relevant  in  our  subsequent  discussion  of  the  transmission  matrix. 

A  grid  qualitatively  of  size  equal  to  width  of  a  speckle  spot  has  fields  that  are  approximately 
uncorrelated.  Because  the  field  within  adjacent  grid  elements  is  uncorrelated,  the  speckle  spot  area  is 
often  referred  to  as  a  “speckle  mode”,  or  a  “coherence  area”.  This  speckle  spot  area  is  related  to  the 
angular  distribution  profile  of  the  contributing  light,  and  within  the  scattering  medium  all  possible  ray 
angles  are  equally  present,  i.e.,  the  spatial  frequency  spectrum  is  approximately  constant.  The  ability  to 
control  the  field  in  each  speckle  mode  relates  to  efficacy  of  removing  the  influence  of  scatter  and 
achieving  an  optical  focus  within  a  scattering  medium. 

2.3.Tutorial:  Transmission  Matrix 


The  granular  nature  of  a  speckle  field,  along  with  the 
fact  that  there  is  an  average  speckle  size,  leads  to  a  very 
convenient  mathematical  approach  to  tackle  wavefront 
shaping.  Specifically,  we  can  discretize  the  input-output 
relationship  of  light  passing  through  any  random  medium, 
leading  to  a  matrix  model  for  the  light’s  scattering  interactions. 
Consider  a  random  medium  with  opposing  surfaces  (faces  A 
and  B,  the  input  and  output  planes,  respectively),  as  shown  in 
Figure  1.  For  simplicity,  we  will  further  assume  that  the 
medium  is  sufficiently  turbid  so  that  the  speckle  field  it 
generates  on  its  back  surface  is  fully  developed  (i.e.,  X/2  in 
diameter,  as  noted  above).  The  Nyquist  (and  Shannon) 


Figure  1:  Light  transmitted  through  a 
scattering  medium  resulting  in  a  speckle 
field. 
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sampling  theorem  then  allows  us  to  fully  describe  face  A  and  face  B  on  a  discretized  sampling  grid  using 
a  A/2  sampling  period.  The  light  transmission  relationship  between  face  A  and  face  B  can  be  characterized 
in  a  matrix  representation  as 

Eb  =  tEA,  (3) 

where  EA  is  the  complex  light  field  on  plane  A  and  EB  is  the  complex  light  field  on  plane  B.  Given  there 
are  M  discrete  elements  in  EA  and  N  discrete  elements  in  EB,  we  see  that  EA  and  EB  are  column  vectors 
containing  M  and  N  elements,  respectively.  Therefore,  we  define  the  (complex,  temporal  frequency 
domain)  transmission  matrix  t  as  an  N  x  M  matrix  that  specifies  the  relationship  between  any  input  field 
Ea  and  the  resulting  output  field  EB.  For  simplicity,  we  will  assume  N  <  M.  By  only  considering  the  light 
transmitted  from  face  A  to  face  B,  t  is  actually  a  subset  of  a  more  complete  transmission  matrix  that  also 
accounts  for  any  reflection  and  for  light  incident  from  both  sides,  which  we  ignore  here  for  simplicity. 

It  is  often  very  convenient  to  re-express  the  transmission  matrix  t  using  singular  value 
decomposition  (SVD) 


t  =  UeV*.  (4) 

Here,  U  and  V  are  (N  x  N)  and  (M  x  M )  unitary  matrices  and  s  is  an  M  x  N  rectangular  diagonal  matrix 
with  real,  non-negative  elements  along  its  diagonal.  This  formulation  is  useful  in  gaining  insights  into  the 
transmission  effectiveness  of  the  scattering  sample.  Matrix  V *  maps  (i.e.,  rotates)  the  incident  light  from 
real  space  coordinates  into  an  orthonormal  basis.  Each  dimension  of  this  new  basis  represents  one  of  M 
“modes”,  or  “eigenmodes”,  of  light  transmission.  These  scattering  modes  are  in  direct  analogy  with  the 
orthonormal  modes  of  a  multimode  optical  fiber.  The  diagonal  matrix  a  assigns  a  nonnegative  scalar 
weight  to  each  independent  scattering  transmission  mode,  and  finally  U  rotates  the  resulting  attenuated 
modes  back  into  real  space.  If  transmission  mode  j  is  multiplied  with  a  diagonal  matrix  weight  %=  1,  then 
all  light  through  this  yth  mode  is  fully  transmitted  from  face  A  to  face  B. 

This  particular  formulation  of  the  random  medium  transmission  is  analogous  to  the  multiple 
input,  multiple  output  (MIMO)  picture  of  antennas  and  receivers.  Random  media  in  the  case  of  radio 
antennas  and  receivers  is  associated  with  structures  and  terrain.  One  of  the  most  significant  MIMO 
results  of  practical  relevance  is  the  concept  of  phase  optimization  for  an  antenna  array.  Considering  the 
antenna  array  as  the  source  of  radiation  input  (side  A),  one  can  optimize  the  relative  phase  of  each  antenna 
to  maximize  the  total  power  delivered  to  an  output  detector  (on  side  B). 

Optimizing  for  total  power  transmission  is  quite  different  than  optimizing  for  maximum  power 
delivery  to  a  localized  area  (i.e.,  a  small  sub-set  of  speckles  in  our  situation).  As  we  will  discuss  later,  the 
maximum  deliverable  power  to  a  single  speckle  spot  on  side  B  scales  linearly  as  function  of  the  number  of 

discrete  controllable  elements  available  on  side  A.  Box  2  provides  additional  information  regarding 
transmission  modes  and  the  distribution  of  power  within  each  mode.  The  interested  reader  is  invited  to 
read  this  background  material  for  a  more  detailed  mathematical  outline  of  the  subject.  Briefly,  the 
optimized  power  in  a  given  channel  has  been  found  to  be  no  more  than  ~2.4  times  greater  than  the  amount 
of  power  delivered  in  the  non-optimized  case  [Marl967,  Mou2000,  Tul2004].  This  result  holds  true  in 
most  optical  domain  transmission  matrix  situations  as  well.  While  there  are  certain  special  cases  where 
the  power  in  one  mode  can  exceed  this  upper  bound  [Vel2008a],  it  is  instructive  to  emphasize  that  most 
problems  concerning  transmission  control  using  wavefront  shaping  will  offer  quite  limited  total 
transmitted  power  enhancement.  However,  the  intensity  of  the  focus  (power  in  a  given  mode)  divided  by 
the  average  of  the  background  (or  peak  to  background  (PBR)  ratio)  is  equal  to  the  number  of  optical 
modes  one  controls  on  the  optical  control  surface.  For  a  typical  SLM,  this  is  about  106  control  variables. 
Experimentally,  ~  100,000  degrees  of  freedom  in  control  is  currently  typical  for  digital  optical  phase 
conjugation,  and  ~  1000  for  feedback-based  wavefront  shaping. 
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Box  2.  What  is  a  bimodal  distribution? 

Can  a  fully  open  transmission  mode  exist  in  a  random  medium  (with  a  singular  value  e  =  1)?  The 
answer  turns  out  to  be  yes,  IF  the  medium  is  a  waveguide,  and  the  point  is  illustrated  in  panels  (a)-(c). 
More  generally  put,  fully  open  channels  exist  if  the  medium  does  not  lose  any  light,  except  through  faces 
A  and  B.  In  such  a  case,  the  distribution  of  singular  values  that  define  the  medium's  input-output  optical 
response  follow  a  bimodal  distribution,  as  derived  in  Refs.  [Dor84,  Pen92,  Bee97].  In  this  distribution, 
each  singular  value  is  either  zero  or  one  (either  £j  =  0  or  Ej  =  1).  This  corresponds  to  each  mode  either 
being  “closed”  or  “open”  to  transmitting  any  light.  The  relative  intensity  transmitted  by  scattering  mode  j 
is  given  by  T  =  £?,  where  Ej  is  the  jth  diagonal  element  of  the  diagonal  matrix  e. 


The  bimodal  distribution  of  the  intensity  transmitted  by  each  mode  has  the  form 

P(T)  =  {T) 


(5) 


2T\1—T 

where  (T)  is  the  average  intensity  transmittance  across  all  N  possible  channels  to  the  output  surface.  The 
probability  of  unity  and  zero  intensity  transmittance  is  thus 

Probability  (T~l)  =  (T)/N  (6a) 

Probability  (T~0)  =  1  —  ( T)/N  (6b) 

where  N  is  the  number  of  optical  modes  that  the  scattering  media  may  transmit  to  side  B.  Therefore,  the 
probability  for  the  channel  to  be  open  becomes  lower  when  the  scattering  media  becomes  more  turbid 
(i.e.,  when  (T)  is  reduced).  The  distribution  of  transmission  coefficients  for  the  case  of  (T)  =  0.1  and  0.01 
are  shown  in  Figure  2. 

In  the  analogous  radio  wave  MIMO  picture  of  multiple  antennas  and  receivers,  the  bimodal 
distribution  will  arise  when  the  neighborhood  is  enclosed  within  a  lossless  reflecting  medium  or  can 
otherwise  be  viewed  as  a  waveguide.  In  such  a  case,  a  solution  exists  for  antenna  transmission  where  all 
of  the  power  can  make  its  way  say  across  a  city  block,  albeit  through  many  random  reflections  off 
different  surfaces. 

In  a  non-waveguide  situation,  what  is  the  channel  distribution? 

In  the  practical  case  where  the  light  propagation  is  lossy  through  the  scattering  medium,  the 
transmission  matrix  components  become  uncorrelated  (i.e.,  the  transmission  matrix  is  no  longer  unitary). 
In  this  lossy  scenario,  the  eigenvalue  distribution  takes  the  form  of  a  quarter  circle  distribution  [Pop2010, 
Marl967] 

A.  i - 

(7) 


P(T)  = 

v  J  R2n 


T2,0  <  T  <  R, 


3n 


where  R  is  —  ( T )  .  In  this  case,  the  channel  with  the  highest  transmission  would  have  a  transmission  value 
that  is  only  -2.36  times  higher  value  than  that  of  the  average.  The  quarter-circle  distribution  of  the 
transmission  coefficients  for  the  case  of  ( T )  =  0.1  and  0.01  are  shown  in  Figure  2. 

Most  practical  situations  involving  random  media  belong  to  this  lossy  category.  We  should 
further  note  that  the  loss  mechanism  does  not  necessarily  have  to  be  leakage-based.  Absorption-based  loss 
will  also  force  a  random  medium  to  take  on  a  quarter  circle  eigenvalue  distribution. _ 


Normal  beam 


Open  channel 


Closed  channel 


Cartoon  of  light  scattering  in  transmission  channels  (a)  with  a  normal  (flat  wavefront)  incident  beam  most  of  the 
light  entering  a  scattering  medium  is  scattered  backwards,  (b)  Light  entering  an  open  channel  traverses  the 
sample  without  backscattering  to  the  incident  side,  (c)  Light  entering  a  closed  channel  is  fully  backscattered  to 
the  incident  side. 
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2.4.  Wavefront  Shaping  Methods 

2.4.1.  Tutorial:  Optimizing  for  Transmission  to  a  Single  Speckle  Spot 


A  large  fraction  of  work  done  related  to  wavefront  shaping  has  not  aimed  to  optimize  total 
transmitted  power.  Instead,  the  goal  of  this  greater  fraction  of  work  was  aimed  at  optimizing  power 
delivery  to  a  single  speckle  spot.  It  is  worth  drawing 
the  distinction.  When  power  delivery  to  a  single  spot  is 
optimized  for  most  scattering  media  (those  that  obey 
the  quarter  circle  distribution  in  their  transmission 
mode  distribution),  the  total  power  transmitted  remains 
largely  unchanged.  This  type  of  spot  optimization  is 
nevertheless  very  useful.  For  example,  this  would  be 
the  case  if  one  has  an  implant  the  size  of  an  optical 
speckle  spot  in  biological  tissue  at  depth  L  and  the 
goal  is  to  deliver  light  maximally  to  that  implant.  Let’ 
us  assume  that  an  area  A  is  illuminated  on  the  skin 
surface  and  the  resulting  speckle  at  depth  L  is  fully 
developed.  Then,  the  power  delivered  to  that  implant 
can  be  boosted  by  a  factor  of  ~  A/(speckle  size)  with 
an  optimized  wavefront,  as  compared  to  the 
unoptimized  case.  However,  in  the  total  power 
reaching  to  depth  L  will  have  remained  unchanged. 

The  correct  wavefront  desired  on  side  A  (given 
control  over  M  speckle  modes/spots),  to  deliver 

optimal  power  to  a  single  speckle  spot  on  side  ff,  is 

found  by  adjusting  the  optical  phase  front  on  side  A. 

The  goal  of  such  an  adjustment  is  to  ensure  the 

contribution  of  each  and  every  speckle  on  face  A  will 

add  in  phase  at  one  desired  speckle  location  on  face  B. 

Suppose  that  the  number  of  modes  on  the  input  and 
output  surface  are  equal  for  simplicity  ( M  =  TV),  and 
that  the  goal  is  to  optimize  power  delivery  to  the  jth 
location  on  side  B.  Mathematically,  the  average 
maximum  intensity  is  given  by  [Pop2010,  Marl967, 
and  Box  3] 

<■ W  =  (/o)p-l)n/4+l ]■  (8) 

Here,  M  is  the  number  of  scattering  transmission  modes  (i.e.,  the  number  of  controllable  speckles  on  side 
A)  and  (70)  is  the  average  light  intensity  in  each  mode  in  the  un-optimized  scenario. 

A  convenient  performance  parameter  is  the  peak  to  (unoptimized)  background  ratio 

PBr  =  (Jmazl  =  [(M  _  1)7r/4  +  q]  (9) 

vo) 

which  is  linearly  proportional  to  the  number  of  controllable  modes,  M.  The  derivation  of  the  maximum 
intensity  to  background  ratio  is  based  on  the  assumption  that  the  random  matrix  follows  an  uncorrelated 
random  Gaussian  distribution.  Notice  that  (9)  is  independent  of  the  scattering  medium  thickness  and  the 
degree  of  scatter.  Provided  the  transmission  matrix  can  be  formed,  thickness  and  scatter  are  black  box 
parameters  that  do  not  impact  the  PBR. 


(a) 


P(T) 


P(T) 


Figure  2:  The  distribution  of  the  transmission 
coefficient  (eigenvalues)  of  eigenchannels  through 
disordered  media:  (a)  a  waveguide  geometry;  (b)  a 
lossy  configuration. 
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Box  3:  Does  the  PBR  depend  on  absorptive  loss? 

For  phase  only  modulation,  the  spatial  light  modulator  is  configured  in  such  a  way  that  all  of  the 
output  modes  constructively  interfere.  This  is  also  true  with  the  presence  of  absorptive  loss.  As  both  the 
maximum  and  the  background  intensity  decrease  at  the  same  rate,  the  ratio  of  maximum  intensity  to 
background  remains  unchanged. 

Is  the  PBR  affected  by  moving  scatterers  in  the  medium  (e.g.,  blood  in  tissue)? 

The  maximum  light  intensity  at  the  target  appears  when  the  modulated  field  compensates  for  the 
phase  of  the  elements  in  the  random  matrix.  This  means  the  phase  of  the  modulated  field  is  phase- 
conjugated  to  the  associated  elements  of  the  transmission  matrix.  With  the  presence  of  moving 
scattereres,  this  phase  conjugation  relationship  between  the  modulated  field  and  the  random  matrix 
weakens  or  vanishes.  Therefore,  the  maximized  light  intensity  at  the  target  reduces  and  with  sufficient 
motion  over  the  measurement  time,  the  spatial  intensity  approaches  the  mean  value. 


2.4.2.  Tutorial:  Major  Wavefront  Shaping  Methods 


Currently,  wavefront-shaping  approaches  can  broadly  be  categorized  into  two  categories.  We 
summarize  the  features  of  each.  Box  4  presents  some  background  information. 


Category  1  -  Adaptive  Optimization:  In  this  method,  the  phase  of  the  light  projected  by  each  spatial 
light  modulator  (SLM)  pixel  on  side  A  is  optimized  to  maximize  the  signal  at  the  target  spot  on  the  other 
side  of  the  scattering  medium  (side  B).  This  can  be  done  in  a  number  of  ways:  (1)  By  progressively 
working  on  the  optimization  for  each  pixel,  the  optimized  wavefront  shaping  solution  is  found.  This 
method’s  challenge  is  that  the  optimization  of  the  (A+l)th  pixel  after  N  pixels  have  been  optimized 
requires  detecting  a  small  signal  change  on  top  of  a  large  established  signal.  (2)  Using  blocks  of  pixels, 
such  as  a  Hadamard  scheme,  where  the  phase  is  optimized  every  time  for  half  of  the  pixels  in  different 
geometries,  or  (3)  Using  a  global  optimization  algorithm,  such  as  the  genetic  algorithm,  to  find  an  optimal 
solution.  It  is  not  hard  to  prove  that  there  is  always  an  optimal  solution  to  the  problem  (that  is,  the 
problem  is  convex),  but  the  underlying  challenge  remains:  Optimization  over  a  large  number  of  pixels  is 
confounded  by  detection  of  a  small  signal  over  a  large  signal  as  N  increases.  In  practice,  the  number  of 
pixels  that  are  used  in  adaptive  optimizations  is  on  the  order  of  -1000,  to  obtain  an  increase  in  the 
intensity  at  the  target  point  by  about  the  same  factor,  even  though  SLMs  with  much  larger  counts  of 
pixels  are  available. 


Box  4:  Shaping  waves  for  imaging  and  focusing 

Spatial  wavefront  shaping  is  a  technique  to  control  light  in  disordered  media  by  manipulating  the  spatial  phase  of 
the  incoming  beam  using  a  spatial  light  modulator  (SLM).  In  its  simplest  version,  the  light  at  one  particular  point 
in  or  behind  the  medium  is  monitored,  and  an  optimization  algorithm  is  applied  to  maximize  the  intensity  at  that 
point. 

In  their  pioneering  work,  Vellekoop  and  Mosk  [Vel2007]  demonstrated  that  this  procedure  can  increase  the 
light  intensity  at  the  desired  point  by  orders  of  magnitude,  a  factor  that  depends  on  the  number  of  controllable 
pixels  in  the  SLM.  While  still  a  small  fraction  of  the  incident  light  power,  this  optimized  point  can  serve  as  an 
effective  focal  point  and  the  basis  of  several  imaging  schemes,  in  particular,  when  combined  with  the  ‘memory 
effect,’  that  enables  scanning  this  focus,  albeit  with  a  limited  spatial  range. 

Principle  of  wavefront  shaping:  (a) 
for  a  plane  light  wave  incident  on  a 
strongly  scattering  sample  such  as  a 
layer  of  white  paint,  the  transmitted 
wave  is  a  low-intensity  disordered 
speckle  pattern;  (b)  a  structured 
wave  adapted  to  the  sample  is 
focused  to  a  tight  spot. 


low-intensity 
plane  speckle 

wave  * 


speckle  intensity 
shaped  increased 


strongly 

scattering 

sample 
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Category  2  -  Optical  Phase  Conjugation  (OPC):  In  this  method,  the  optimization  is  done  in  one  shot  by 
the  following  means.  First,  light  illuminates  the  target  spot  on  side  B.  The  transmission  through  to  side  A 
is  then  interferometrically  beaten  (heterodyned)  with  a  reference  beam  and  detected  by  a  camera.  Through 
this  means,  the  optimized  wavefront  solution  for  side  A  to  maximize  signal  on  the  target  spot  is  found  -  it 
is  the  phase  conjugate  version  of  the  detected  interference  pattern.  By  imprinting  this  solution  on  an  SLM 
that  is  exactly  aligned  to  the  camera,  one  can  generate  the  requisite  optimized  wavefront.  This  approach  is 
technically  challenging  to  implement,  as  it  requires  the  camera  and  SLM  to  be  exactingly  aligned. 
However,  once  aligned,  this  method  yields  a  very  quick  optimized  wavefront  solution.  Increasing  N  is 
also  straightforward  and  does  not  run  into  the  issue  described  above  for  Category  1.  In  experiments,  N  on 
the  order  of  100,000  has  been  achieved  using  this  approach. 

2.4.3.  Tutorial:  Optical  Memory  Effect 

Imagine  a  coherent  wave  illuminating  a  scattering  medium  of  thickness  L,  and  consider  the 
speckle  pattern  formed  on  the  other  side  of  that  medium  (Figure  3).  Now,  if  the  input  wave  is  tilted  by  a 
small  angle  0,  the  first  order  effect  on  the  speckle  pattern  is  just  to  shift  by  0L.  If  the  wavefront  has  been 
shaped  for  focusing  in  the  medium  as  in  Figure  3(b)  below,  tilting  the  wave  as  in  Figure  3(c)  will  shift  the 
focus,  an  effect  that  could  be  used  for  scanning.  The  tilt  range  of  the  “memory  effect”  is  limited  by  the 

speckle  correlation  length,  and  it  can  be  estimated  for  strong  scatterer  by  9max  = 

Very  high-resolution  information  is  present  in  the  intricate  speckle  correlations  in  the  scattered 
light  [Frel990].  Recently,  a  method  was  demonstrated  to  image  through  strongly  scattering  thin  layers 
using  these  speckle  correlations  [Ber2012,  Yil2013].  This  speckle-scan  imaging  demonstrates  that  high- 
resolution  optical  imaging  is  possible  even  in  cases  where  no  ballistic  light  is  present.  This  non-invasive 
imaging  method  has  already  resulted  in  several  applications  [Kat2014a,  Jud2013,  Yan2014].  Speckle 
scanning  methods  rely  on  the  “angular  memory  effect”  in  speckle  correlations  [Frel990,  Li  1994, 
Fenl988],  and  for  a  long  time  such  correlations  were  thought  to  exist  only  in  very  thin  scattering  media. 
Recently,  it  has  been  shown  that  these  correlations  are  also  present  in  light  reflected  by  a  strongly 
scattering  wall  [Kat2012].  Moreover,  a  new  type  of  speckle  correlation,  a  “positional  memory  effect”  has 
been  discovered  that  exists  in  thicker,  less  strongly  scattering  materials  such  as  biological  tissue 
[Jud20 15].  It  is  an  open  question  how  general  this  new  memory  effect  is,  and  whether,  as  with  the  angular 
memory  effect,  has  a  range  that  counter  intuitively  can  be  increased  by  absorption  [Berl989]. 


2.4.4.  Wavefront  Shaping  Research  Status 

Spatial  wavefront  shaping  [Vel2007]  is  a  method  pioneered  by  Mosk  and  coworkers  to  control 
light  in  disordered  materials  (see  Box  2,  or  for  a  review  of  this  method  and  its  extensive  impact  on  the 
field,  see  [Mos2012]).  By  optimizing  the  phase  of  the  incident  field  in  a  large  number  of  pixels,  one  can 
control  the  intensity  in  one  or  more  locations  behind  the  sample  [Vel2007,  Vel2010a].  Using  different 
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feedback  strategies  one  can  create  a  focus  inside  the  sample  [Vel2008b]  or  even  at  a  specific  time 
[Aul2011,  Kat2011,  McC2011].  Wavefront  shaping  has  been  applied  to  a  variety  of  imaging  and  focusing 
tasks.  Optical  tweezers  have  been  realized  using  multiply  scattered  light  and  wavefront  correction 
[Ciz2010]. 

Using  correlations  in  the  transmission  matrix  [Frel990]  or  pre-calibrated  transmission  matrix 
data,  images  have  been  achieved  through  turbid  media  [Hsi2010,  Pop2010,  Yu2013].  Using  wavefront 
shaping,  one  can  even  increase  the  resolution  of  an  image  [Par2013].  Wavefront  shaping  was  combined 
with  strongly  scattering  semiconductor  materials  to  obtain  a  scattering  lens  with  a  record  resolution  of  97 
nm  [Put2011]. 

Wavefront  shaping  has  been  used  to  create  a  focus  through  multimode  fibers,  for  optical 
micromanipulation  and  imaging  [Ciz2011,  Cho2012,  DiL2011,  Mah2013,  Pap2013].  The  intriguing 
consequence  of  this  work  is  that  multimode  fibers  offer  high  resolution  and  are  physically  small,  and  they 
offer  a  good  opportunity  to  realize  a  “needle  endoscope”,  which  is  of  great  medical  relevance  [Gig2012]. 

A  very  interesting  development  is  the  use  of  wavefront  shaping  for  direct  imaging  using 
broadband  light  [Kat2012].  For  thin  scattering  systems,  the  correlation  frequency  is  broad  enough  to 
allow  for  imaging  using  filtered  thermal  light  or  light  from  light  emitting  diodes  (LEDs).  In  addition, 
wavefront  shaping  of  reflected  light  has  been  shown. 

Using  wavefront  shaping,  an  intriguing  effect  in  scattering  media  has  been  elucidated:  the 
existence  of  open  transport  channels  [Dorl984,  Mell988,  Fenl988,  Penl990,  Barl991,  Beel997, 
Pen2008,  Vel2008a].  Light  entering  such  an  open  channel  is  transported  through  the  medium  without 
backscattering  loss,  theoretically  even  for  very  thick  (but  nonabsorbing)  media  and  with  strong  scatter 
[Che2014].  Conversely,  in  a  thick  medium,  the  majority  of  channels  are  closed:  light  entering  a  closed 
channel  is  completely  backscattered.  To  enter  an  open  or  closed  channel,  the  wavefront  of  the  incident 
light  must  match  the  channel  like  a  lock  and  key.  In  nonabsorbing  samples,  light  is  fully  transmitted 
(scattered)  in  open  channels.  In  strongly  absorbing  materials,  there  are  comparable  nonrefleetive  channels 
in  which  light  is  fully  absorbed  internally  [Cho2011].  The  exact  character  of  open  channels  remains  an 
area  of  active  theoretical  and  experimental  investigation  [Bei2011,  Choi2011a,  Ber2005,  Pen2008, 
Shi2012,  Dav2012,  Kim2012,  Goe2013,  Yu2013,  Hao2014].  Recently,  it  was  found  that  in  partially 
absorbing  materials,  light  entering  open  channels  is  injected  deeply  and  its  path  is  less  disturbed  by  scatter 
[Lie2014], 

2.4.5.  Distinction  between  Adaptive  Optics  and  Wavefront  Shaping 

We  note  the  distinction  between  wavefront  shaping  and  adaptive  optics.  The  field  of  adaptive  optics 
[Harl998,  Tys2010]  aims  to  correct  aberrations  in  optical  systems,  due  to,  e.g.,  atmospheric  turbulence  or 
refractive  index  variations  [Boo2007,  Boo2012].  The  correction  is  typically  implemented  by  a  deformable 
mirror  or  spatial  light  modulator  [Mau2011],  and  may  be  based  on  models  of  the  disturbance  or  on  model- 
free  measurements.  Typical  adaptive  optics  systems  efficiently  correct  for  aberrations  that  takes  place  in 
(or  near)  a  specific  plane,  while  the  recently  developed  multi-conjugate  adaptive  optics  can  correct 
aberrations  in  multiple  planes  [Tys2010,  Sim2013,  Boo2012,  Boo2014].  The  corrections  implemented  by 
adaptive  optics  systems  can  drastically  improve  the  sharpness  of  the  focus,  and  therefore  the  resolution 
with  modest  scatter.  However,  adaptive  optics  typically  uses  a  small  number  of  degrees  of  freedom,  on 
the  order  of  10-100,  so  that  it  can  correct  for  aberrations  (i.e.,  weak  scatter)  but  not  for  scatter  (more 
strongly  scattering  centers  and  multiple  scatter).  Wavefront  shaping,  in  contrast  to  typical  adaptive  optics 
systems,  uses  up  to  hundreds  of  thousands  of  degrees  of  freedom  to  control  (multiply)  scattered  light. 
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2.5.  Guidestars  for  Control  of  Coherent  Light  in  Random  Media 
2.5.1.  Tutorial:  Concept  of  Guidestars 


One  of  the  most  useful  things  enabled  by  wavefront  shaping  is  the  focusing  of  light  within  a 
random  medium.  A  focused  spot  of  light  within  a  random  medium  can  open  up  a  broad  range  of 
biomedically  relevant  applications,  such  as  targeted  optical  chemical  analysis,  precise  tissue  ablation,  and 
targeted  optical  activation.  To  create  a  focused  light  spot  within  a  scattering  medium  requires  two 
conditions:  1)  the  medium  is  sufficiently  stable  that  an  optimized  wavefront  solution  can  be  found  within 
the  time  frame  defined  by  stability,  and  2)  a  guide  star  of  some  type  at  the  point  of  interest  within  the 
medium  (to  provide  feedback  about  the  instensity). 

A  guidestar  is  simply  a  way  by  which  the  light  emerging  or  transversing  the  voxel  of  interest  can 
be  tagged  or  preferentially  detected.  We  operationally  define  a  guidestar  as  any  mechanism  that  produces 
an  effective  source  (virtual  or  real)  of  sufficiently  coherent  radiation  inside  a  medium.  This  could  be  an 
actual  internal  source,  such  as  an  emitting  molecule,  an  optical  nonlinearity,  or  a  modulation  of  the  local 
material  parameters  produced  by  additional  fields,  e.g.,  ultrasound  waves.  We  review  the  most  relevant 
implementations  in  the  next  section. 


a.  Recording  Ultrasound 


b.  Playback  Ultrasound 


Figure  4:  Principles  of  digital  TRUE,  (a) 
Recording:  an  ultrasound  transducer  (frequency 
=  f)  is  used  to  focus  acoustic  power  into  a 
desired  voxel.  A  weak  probe  beam  is  then  sent 
through  the  tissue.  Some  of  the  light  passes 
through  the  ultrasound  focus  and  is  frequency 
upshifted  (by  f).  By  interfering  this  upshifted 
component  that  emerges  from  the  tissue  with  a 
reference  beam  with  the  DOPC  system’s 
camera,  its  exact  wavefront  can  be 
characterized,  (b)  Playback:  the  conjugated 
phase  map  is  sent  to  the  spatial  light  modulator 
(SLM).  A  blank  beam  is  then  sent  to  the  SLM 
and  reflected  off  it.  By  doing  this,  the  SLM  will 
‘imprint’  a  phase  conjugate  (or  time-reversed) 
wavefront  variation  onto  the  blank  beam.  This 
modified  beam  will  then  travel  back  through 
the  sample  and  come  to  a  focus  at  the  target 
voxel,  (c)  Setup  for  direct  visualization  of  the 
focusing  beam  profile,  (d)  Optical  beam  profile 
without  TRUE,  (e)  TRUE  focus.  Figure  d  and  e 
reproduced  from  [Wan2012b],  ©  2012  NPG. 


2.5.2.  Guidestar  Research  Status 

One  popular  and  very  promising  implementation  of  a  guidestar  is  based  on  focused  ultrasound 
modulation  [Xu2011,  Lai2011,  Si2012,  Jud2013].  This  method  relies  on  the  acousto-optical  effect  which 
frequency-shifts  photons  that  pass  through  an  ultrasound  focus.  The  frequency-shifted  photons  are  then 
phase  conjugated  and  make  their  way  back  to  the  focus.  Lihong  Wang’s  group  first  demonstrated  the  use 
of  time  reversal  for  focusing  and  controlling  light  inside  a  random  medium  (tissue)  [Lai2011]  through  the 
use  of  ultrasound  tagging.  By  combining  the  time-reversal  property  of  light  propagation  with  ultrasound 
tagging,  the  group  achieved  a  sub-millimeter  scale  optical  focus  within  a  tissue  phantom;  the  technique 
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was  named  time-reversal  ultrasound 
encoded  (TRUE)  focusing  [Xux2011]. 

By  moving  to  an  optoelectronic 
method  for  implementing  OPC 
(digital  OPC),  which  provides  high 
focusing  efficiency,  Yang’s  group 
demonstrated  deep  tissue  fluorescence 
imaging  with  digital  TRUE  technique 
(Figure  4)  [Wan2012b,  Rua2014]. 

Because  ultrasound  focus  can  be 
flexibly  placed  at  arbitrary  positions 
within  a  random  medium,  the  TRUE 
method  is  so  far  the  only  method  that 
allows  an  optical  focus  to  move  freely 
within  random  media  noninvasively. 

Fluorescence  was  also 
demonstrated  to  be  a  useful  guide  star 
candidate  for  OPC.  Vellekoop  et  al. 

[Vell2]  (Yang’s  group)  measured  the 
wavefront  from  a  filtered  fluorescent 
target  behind  a  0.5  mm  thick  ex  vivo 
chicken  breast  tissue  and  sent  back  the 
phase-conjugated  light.  Light  was  then 
successfully  focused  onto  the 
fluorescent  target  due  to  the  time- 
reversal  symmetry.  Specifically, 
targeting  fluorescence  with  light  has  a 
promising  future  because  fluorescence 
is  widely  used  in  the  biomedical  area  as  a  biomarkers. 

In  order  to  focus  light  using  multiple  output  modes  or  at  arbitrary  points,  the  (field)  transmission 
matrix  of  the  scattering  medium  needs  to  be  measured.  With  full  knowledge  of  the  transmission  matrix, 
communication  with  coherent  light  through  great  amounts  of  scatter  is  in  principle  possible.  Transmission 
matrix  measurement  of  0.5  mm  thick  chicken  tissue  was  demonstrated  [Cha2013]  using  photoacoustic 
signals  from  multiple  optical  absorption  objects  as  feedback.  Using  red  blood  cells  as  the  photoacoustic 
source,  this  method  has  potential  for  light  delivery  to  biological  tissues  noninvasively.  In  contrast  to  using 
endogenous  guide  stars,  it  is  also  possible  to  create  virtual  guide  stars  between  the  scattering  layers  by 
using  ultrasound  to  modulate  scattered  light  within  the  tissue  to  map  out  the  transmission  matrix  over  a 
limited  area  [Jud2013]  (Yang’s  group).  The  method,  termed  Time-Reversed  Optical  Variance-Encoded 
light  (TROVE),  can  identify  a  single  optical  mode  within  the  ultrasound  profile,  which  typically  contains 
hundreds  of  optical  modes.  Ultrasound-modulated  light  with  various  realizations  of  the  incident  speckle 
field  was  sampled,  and  shifting  and  weighting  the  ultrasound  profile  uniquely  encoded  the  positions  of  the 
optical  modes  within  the  ultrasound  profile.  Analyzing  the  variance  of  the  ultrasound  modulated  light 
intensity  can  then  isolate  these  optical  modes.  Therefore,  this  method  essentially  measures  the 
transmission  matrix  of  the  scattering  layers.  Compared  to  the  previous  transmission  matrix  measurement 
method,  TROVE  allows  the  light  focus  to  be  steered  arbitrary  within  a  certain  depth.  TROVE  also  has 
potential  for  light  focusing  within  the  tissue,  as  does  a  previous  time-reversed  ultrasonic  ally  encoded 
(TRUE)  light  technique  (Figure  4)  [Wan2012b].  The  approach  offers  fast  beam  steering  and  high 
resolution,  but  the  measurement  of  the  transmission  matrix  is  slow  and  likely  to  be  impractical  for  in 
vivo  tissue  and  other  rapidly  changing  random  media  applications. 

There  are  other  methods  for  implementing  a  guide  star  within  a  random  medium  for  optical 
focusing  purposes.  One  such  technique  is  termed  Time  Reversal  by  Analysis  of  Changing  wavefronts 
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generation  t 

Figure  5:  Focusing  on  a  fluorescent  sample  with  iterative 
optimization,  (a)  Experiment  setup:  A  spatial  light  modulator 
(SLM)  is  used  to  shape  the  incident  wavefront  based  on  the 
feedback  from  the  target,  (b)  Image  of  the  sample  plane  without 
optimization,  (c)  Optimized  focus,  (d)  Fluorescent  signal 
enhancement  over  generations  of  the  genetic  algorithm.  Figure 
reproduced  from  [Kat2014b],  ©  2014  OSA. 
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from  Kinetic  targets  (TRACK) 

[Zho2014a]  (also  called  time -reversed 
adapted-perturbation  (TRAP)  in  a 
separate,  independent  work  [Ma2014]). 

This  method  measures  two  optical 
fields  with  a  target  point  scatterer  at 
two  different  locations  in  the  random 
medium.  By  taking  the  difference 
between  two  fields  (background 
subtraction),  this  method  essentially 
extracts  the  field  scattered  only  from 
the  moving  target.  By  playing  back  an 
optical  phase  conjugate  copy  of  the 
difference  light  field,  the  OPC  field  is 
then  able  to  create  an  optical  focus  at 
the  target’s  location. 

Although  the  OPC  technique 
generally  involves  a  two-step  process 
(wavefront  recording  and  playback),  its 
focusing  speed  is  high  enough  (-100 
ms)  for  some  biological  applications 
where  tissues  can  be  properly 
immobilized.  Cui  et  al.  [Cui2010b] 
experimentally  obtained  light  focus 
through  a  pinched  rabbit  ear  in  vivo. 

Recently,  Jang  et  al.  [Jan2015] 
successfully  created  a  light  focus 
through  immobilized  live  mouse  dorsal 
skin  flab  and  characterized  the 
relationship  between  light  intensity 
decay  at  the  focus  and  tissue 
decorrelation.  These  experiments 
provide  evidences  that  the  OPC  technique  has  significant  potential  for  focusing  light  within  biological 
tissue  in  vivo.  The  approach  provides  fast  wavefront  optimization  for  a  single  point  but  requires  coherent 
or  partially  coherent  guide  star  sources. 

Yet  another  way  to  implement  a  guidestar  uses  a  fluorescent  target.  The  Mosk  group  showed  that 
by  adjusting  the  optical  wavefront  of  the  excitation  light  to  maximize  fluorescence  from  a  turbid  sample, 
it  is  possible  to  focus  light  onto  the  fluorescent  target  [Vel2008b].  The  effectiveness  of  the  focus  can  be 
enhanced  by  using  nonlinear  feedback  such  as  two-photon  fluorescence  and  optimizing  the  total 
fluorescence  as  measured  back  through  the  scattering  layer  (Figure  5).  Combined  with  the  memory  effect, 
a  scanned  image  of  the  fluorescence  object  could  be  obtained  [Kat2014a].  Nonlinear  feedback  also 
ensures  that  wavefront  shaping  of  short  pulses  will  result  in  compressed  pulses  at  the  focus  [Kat2011], 
important  for  nonlinear  microscopy  modalities.  This  class  of  guidestar  approach  is  all-optical  in  nature. 

Although  the  SLM  dominates  wavefront  shaping  devices,  its  operation  speed  is  one  of  the  major 
hurdles  for  it  to  be  widely  used  in  applications  associated  with  tissue  in  vivo.  Nixon  et  al.  [Nix2013] 
recently  reported  an  all-optical  feedback  method  based  on  an  optical  focusing  technique  that  was  able  to 
focus  light  through  a  200  micrometer  chicken  breast  sample  on  a  sub-microsecond  timescale  (Figure  6). 
This  approach  relies  on  a  field  self-organization  process  within  a  multimode  laser  cavity  in  which  the 
lasing  process  naturally  selects  the  lasing  state  with  minimal  loss.  Although  the  retro-reflecting 
configuration,  which  is  needed  for  lasing,  is  difficult  to  adapt  to  focus  light  inside  biological  tissue 
noninvasively,  this  method  provides  opportunities  for  high  speed  wavefront  shaping. 


Figure  6:  Wavefront  shaping  through  scattering  media  by  all- 
optical  feedback,  (a)  Experimental  setup:  a  scattering  sample  is 
placed  inside  a  degenerate  self-imaging  4f  cavity.  A  pinhole  placed 
at  the  centre  of  the  cavity  serves  as  the  target  for  light  focusing, 
ensuring  that  only  focused  components  of  the  light  are  fed  back  to 
the  gain  medium,  (b)  Intensity  disttibution  at  the  target  plane  for 
conventional  focusing  of  a  plane  wave  from  an  external  source 
through  a  200-mm-thick  slice  of  chicken  breast,  (c)  Intensity 
distribution  at  the  target  plane  for  the  lasing  pattern,  demonstrating 
sharp  focusing  of  the  light  through  the  scattering  sample  on  the 
target.  Scale  bars,  1  mm.  Figure  reproduced  from  [Nix2013],  © 
2013  NPG. 


14 


One  of  the  main  difficulties  in  wavefront  shaping  is  the  need  to  measure  the  light  distribution  in 
the  region  where  we  want  to  optimize  it,  as  this  could  be  inside  the  medium  or  behind  it  in  a  region  that 
may  not  be  accessible.  One  solution  is  to  insert  a  ‘guide  star”,  a  reporter  that  will  localized  at  the  desired 
focal  point  and  will,  for  example,  fluoresce  or  otherwise  send  a  signal  proportional  to  the  light  intensity  at 
that  location,  but  this  of  course  is  invasive.  It  is  possible,  however,  to  optimize  the  wavefront  non- 
invasively,  when  the  medium  responds  in  a  nonlinear  way,  for  example  when  it  is  n-photon  fluorescence 
(and  therefore  the  fluorescence  intensity  grows  as  l(rf)  .  In  that  case,  the  total  integrated  fluorescence 
from  the  entire  sample  will  grow  if  the  light  is  focused,  and  then  it  is  possible  to  form  a  focus  by 
optimizing  the  total  fluorescence  without  observing  the  focal  region  directly.  This  should  work  in  any 
sample  when  n> 2,  however,  in  the  case  of  n= 2,  that  is  the  common  case  of  two-photon  fluorescence, 
optimization  of  total  fluorescence  will  be  effective  only  for  thin  fluorescence  layers  (or  in  sparsely 
fluorescence  specimens). 


2.6.  Tutorial:  The  Diffusion  Model 


Under  restricted  scatterer  densities  that  will  hold  in  most  practical  situations,  and  the  assumption 
that  scatter  dominates  absorption,  the  diffusion  equation  describes  the  mean  intensity  with  sufficiently 
heavy  scatter.  In  this  way,  the  geometry  of  the  scattering  medium  in  relation  to  the  sources  and  detectors 
can  be  considered. 

The  diffusion  equation  in  the  time  domain  can  be  written  as 

cit^(r,t)  ~~  Dv2(P(r't)  +  Ha<P(r,t)  =  S(r,  t),  (10) 

where  c  is  the  speed  of  light  in  the  medium,  D  is  the  diffusion  coefficient  given  by  D  =  {3[pa  +  (1  — 
g)ps]r\  Pa  is  the  absorption  coefficient,  Ps  =  (1  —  p)ps  is  the  reduced  scattering  coefficient,  with  ps 
the  scattering  coefficient  and  g  is  the  mean  cosine  of  the  scattering  angle.  S(r,  t)  is  the  photon  source,  and 
for  an  isotropic  point  source  at  the  origin,  it  is  equivalent  to  8(0,0). 

The  solution  to  (10)  in  an  infinite  homogenous  medium  is  given  by  the  Green’s  function 

0(r,t)  =  c(4nDcty3/2  exp(--^-  nact).  (11) 

The  photon  current  density  can  then  be  calculated  from  Fick’s  law,  where 

/(r,  t)  =  —DVr(p(r,  t),  (12) 

which  gives 

Q  =  iscLy/*  (T  5/2>*P  (-  -  /*«<*)■  <13) 


Normalizing  the  current  density  at  a  position  r0  gives  the  temporal  path  length  distribution  p(t)  as 


p(t)  = 


J(r0,t ) 


(14) 


/  ](r0,t)dt  ' 

Because  p(t)  does  not  have  a  simple  analytical  solution,  we  show  a  plot  of  a  numerical  solution  in  Figure 
7.  This  result  gives  the  path  length  distribution  from  a  point  source  at  the  origin  to  points  on  the  surface  of 
a  sphere  with  a  radius  of  100  mm.  From  the  expected  value  of  t  we  can  estimate  the  mean  path  length  as 


( l )  =  c(t), 


(15) 
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where  ( t )  is  the  expected  time  for  a  photon  to  travel  a  distance  r  from  the  origin.  Additionally,  the 
coherence  length  can  be  estimated  from  the  standard  deviation  of  t,  crt,  as 

ol  —  c  •  at.  (16) 

We  see  that  the  expected  value  and  standard  deviation  of  t  do  not  depend  on  the  normalization  in 
(14).  Thus,  (13)  can  be  used  to  estimate  the  coherence  length  requirement  for  light,  as  well  as  the  mean 
path  length  and  the  spread  (where  the  spread  relates  to  source  coherence  requirements).  For  example,  we 
see  that  if  r  is  increased  in  (13),  both  the  coherence  length  and  the  mean  free  path  will  increase,  as 
expected.  Another  estimate  for  the  mean  path  length  can  be  obtained  from  (13)  by  assuming  =  0,  l*  = 
4D,  l  =  ct,  and  solving  for  1  when  the  exponential  decay  reaches  the  e-1  point.  This  results  in 

l  —  r2/r.  (17) 


t(  ps) 

Figure  7:  Plot  of  p(t)  in  (9)  using  c  =  3xl08  m/s,  pa  =  0,  ps  =  10  mm-1,  and  r  =  100  mm.  The  integral 
of  p(t)  over  the  time  scale  is  1,  as  expected  for  a  probability  distribution.  The  expected  value  (t)  of  t  is  0.261 
ps  and  the  standard  deviation  at  of  t  is  0.201  ps.  Using  equations  (15)  and  (16),  the  mean  free  path  is  78  m  and 
the  coherence  length  is  60  m. 


2.6.1.  Diffuse  Optical  Tomography  (DOT  or  ODT) 


With  a  model  for  the  scatter,  for  example,  the  diffusion  equation  given  in  (10),  image  and  sensory 
information  for  objects  in  the  scattering  medium  can  be  obtained.  The  recovery  of  the  shape  of  an 
embedded  object  or  the  reconstruction  of  the  scattering  and  absorption  parameters  (ji's  and  pa)  is  known 
as  diffuse  optical  tomography  (ODT)  [Yel999a,  Yel999b,  Ye2001,  Oh2005]  and  also  diffuse  optical 
tomography  [Arrl999,  Dur2004].  ODT  has  proven  to  be  a  powerful  modality  and  applied  successfully  in 
biomedical  imaging  [Boa2001],  such  as  the  study  of  breast  cancer  [Bov2007,  Fan2008].  An  important 
application  of  ODT  is  the  imaging  of  fluorophores  that  are  coupled  with  cancer  targeting  agents  [Ball997, 
Bec2001,Mil2004,  Ntz2006].  An  example  ODT  reconstruction  of  3D  printed  mice  is  shown  in  Figure  8. 

In  frequency-domain  fluorescence  ODT  (FODT),  sinusoidally  modulated  light  at  the 
fluorophore’s  excitation  wavelength  kx  is  launched  into  the  tissue.  When  the  excited  fluorophores  decay 
to  the  ground  state,  they  emit  light  at  a  longer  (emission)  wavelength  km,  and  this  emission  is  measured  by 
an  array  of  detection  devices.  These  emission  data  are  used  to  perform  a  volumetric  reconstruction  of  the 
yield  (a  measure  of  the  fluorescence  efficiency)  and  the  lifetime  (the  fluorescent  decay  parameter).  The 
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Figure  8:  3D  printed  phantoms  with  inhomogeneities  in  the  shape  of  the  kidneys  (top).  Experimental  data 
captured  form  the  mouse  second  to  the  right  (with  highly  scattering  inhomogeneities)  was  used  for  an  ODT 
reconstruction  of  the  absorption  and  scatter  parameters.  The  results  of  this  reconstruction  are  shown  (bottom) 
[Ben2015], 


task  in  FODT  is  to  determine  the  image  from  an  appropriate  measurement  set.  FODT  can  further  be 
applied  to  image  Fluorescence  (or  Forster)  resonance  energy  transfer  (FRET)  [Forl948,  Gai2009, 
Gai2010].  FRET  is  a  non-radiative  energy  transfer  process  between  donor  and  acceptor  (DA) 
fluorophores  spatially  separated  by  a  distance  usually  between  1-10  nm  that  can  provide  invaluable 
information  for  nanomedicine.  For  example,  in  vitro  FRET  applications  have  shown  the  FRET  distance 
(the  distance  between  DA  molecules)  can  be  used  as  an  indicator  of  molecular  activity  [Tru2001].  With 
ODT,  it  is  possible  to  image  FRET  parameters,  including  the  nanoscale  DA  distance  [Gai2009,  Gai2010], 
in  a  method  called  FRET-ODT. 

ODT  (or  DOT)  has  recently  seen  a  major  advance  in  spatial  resolution  through  the  so  called  high 
density  diffuse  optical  tomography  (HD-DOT)  methods  [Zef2007,Whi2010].  HD-DOT  has  been  very 
successful  at  mapping  distributed  brain  function  and  networks  [Eggebrecht2014]  throughout  the  whole 
human  brain  with  mm  location  errors  [Wu2014].  The  method  relies  on  a  high-density  array  of  sources  and 
detectors  and  either  prior  known  subject  specific  models  (obtained  using,  for  example,  MRI),  or  a  human 
brain  atlas  to  form  images  with  high  spatial  resolution. 

The  spatial  resolution  limits  of  DOT  can  be  understood  in  terms  of  diffuse  photon  density  waves 
(DPDW),  which  are  wave  solutions  to  the  diffusion  equation  given  in  (10).  In  the  frequency  domain,  and 
assuming  the  light  is  modulated  with  an  angular  frequency  <n,  the  average  intensity  within  a  turbid 
medium  obeys  the  Helmholtz  equation  with  wave  number  k0  =  (— / ia/D  +  icjn/cD)1^2,  where  i  is  the 
square  root  of  negative  one.  Note  that  the  wave  number  is  always  complex  (even  when  there  is  no 
absorption)  because  of  loss  by  diffusion,  giving  k0  —  kr  +  ikt.  The  amount  of  spatial  information 
propagated  through  the  highly  scattering  medium  by  a  superposition  of  DPDW  limits  the  spatial 
resolution  of  the  imaging  method  [Rip  1999].  In  free  space,  propagating  scalar  waves  give  rise  to  the  well- 
known  Rayleigh  resolution  limit  of  1/2  due  to  the  exponential  decay  of  near  field  or  evanescent  waves. 
Interestingly,  DPDW  are  typically  measured  in  the  near- field  due  to  their  long  wavelength  (A0  =  2n/kr 
being  7.53  cm  in  breast  tissue)  meaning  all  wave  solutions  propagate  to  the  detector.  Therefore,  assuming 
sufficient  source-detector  diversity,  the  resolution  of  DOT  is  fundamentally  limited  only  by  the  SNR  at 
the  detectors.  However,  if  we  consider  the  superposition  of  DPDW,  the  propagation  transfer  function 
(details  in  [Ripl999])  is  given  by  F(K,  z)  =  exp\iq(K)z] ,  where  \K\2  +  q2  =  k2  ,  implying  K  = 
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(Kx.Ky)  is  a  real  vector,  and  q(K)  =  (k2  —  \K\2).  Since  q(K)  is  always  complex  due  to  loss  by 
diffusion,  the  amplitude  and  phase  of  the  DPDWs  decay  exponentially  with  distance,  effectively  making 
F  (K,  z)  a  spatial  frequency  filter  which  dampens  high  spatial  information  below  the  noise  floor  of  the 
detector.  This  dampening  causes  the  spatial  resolution  to  decrease  exponentially  with  depth  (z).  With 
current  detector  technology,  resolutions  between  about  1  mm  [Gra2003]  and  1  cm  (depending  on  depth) 
are  typical  for  DOT.  Graves  et  al.  achieved  0.7  mm  resolution  through  0.75  cm  (with  the  assistance  of 
fluorescence)  giving  a  resolution  of  about  depth/10.  As  optical  detector  technology  and  ODT  algorithms 
continue  to  progress  however,  better  spatial  resolutions  should  become  possible. 

2.7.  Current  Technology 


We  present  some  critical  aspects  of  the  relevant  instruments  in  this  section.  An  important 
parameter  is  the  required  speed  of  measurement,  dictated  by  the  velocity  distribution  of  the  scatters,  in 
relation  to  concomitant  requirements  on  the  sources  and  detectors. 

2.7.1.  Spatial  Optical  Modulators 

There  are  several  sub-classes  of  spatial  phase  modulators  that  are  relevant.  Deformable  mirrors 
are  used  broadly  in  adaptive  optics  applications.  They  tend  to  have  a  small  number  of  active  elements 
(-100  -  1000)  and  are  generally  deemed  to  be  less  useful  for  speckle-field  type  wavefront  engineering. 
Liquid  crystal-based  SLMs  are  extensively  used  in  wavefront  control  research.  SLMs  are  currently 
available  with  pixel  counts  up  in  the  range  of  megapixels  and  response  time  of  1-10  ms.  Liquid  crystal- 
based  methods  are  intrinsically  limited  in  their  response  time  -  1  ms  is  likely  the  practical  limit  for  this 
technological  approach.  Digital  micromirror  devices  (DMDs)  are  another  means  for  wavefront  shaping 
that  is  limited  to  binary  phase  or  amplitude  modulation.  The  benefit  of  this  approach  is  that  the 
technology  is  semiconductor  based  and  directly  scalable  for  higher  pixel  count,  and  it  has  the  potential  for 
high-speed  operation.  Having  a  larger  pixel  count  is  generally  more  desirable  than  a  higher  number  of 
levels  in  phase  control. 

2.7.2.  Cameras 

Not  all  wavefront  methods  discussed  require  optical  wavefront  detection.  For  those  that  do,  high 
speed  and  high  pixel  count  are  the  two  primary  considerations.  Achieving  a  sensitivity  near  to  the  shot 
noise  limit  is  generally  not  considered  a  particular  challenge  as  the  wavefront  measurement  process 
generally  involves  the  use  of  interferometry,  and  shot  noise  level  detection  can  be  accomplished  as  long 
as  the  reference  field  is  sufficiently  strong  (because  the  reference  arm  provides  gain).  The  pixel  count  is 
currently  in  the  10-100  megapixel  range.  The  bit  depth  of  the  camera  is  relevant  in  most  applications. 
During  interferometry  measurements,  the  signal  is  weak  and  riding  on  top  of  a  strong  DC  background 
(due  to  the  strong  reference  field).  A  large  bit  depth  camera  ensures  that  we  are  able  to  detect  that  weak 
signal.  A  16  bit  camera  is  generally  used,  but  it  is  the  last  2-4  bits  in  the  measurements  that  are  critical. 
The  high  bit  count  has  the  unfortunate  downside  of  creating  a  high  data  volume  download  burden  from 
the  camera.  A  camera  that  is  capable  of  only  measuring  the  weak  relevant  signal  (which  can  be  made  to 
oscillate)  is  highly  desirable  for  this  research  area. 

In  DOT,  a  gated  image  intensifier  can  be  used  on  a  camera.  Application  of  a  gate  signal  allows 
the  temporal  response  of  the  modulated  light  detected  to  be  determined  as  a  function  of  position,  as 
imaged  onto  each  pixel  in  the  camera.  This  type  of  technology  can  potentially  be  applied  to  address  the 
weak  signal  on  a  large  DC  problem  stated  previously.  One  challenge  for  in  vivo  experiments  is  the  read¬ 
out  time  for  such  cameras. 
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3.  Research  Opportunities 

3.1.  Practical  Limits  on  Amount  of  Scatter 

3.1.1.  Stationary,  Spherical  Cloud  Model 

Consider  a  coherent  source  that  continuously  emits  power  ft,  surrounded  by  a  uniform,  perfectly 
transparent  scattering  medium  (say  a  laser  inside  a  cloud).  Imagine  a  spherical  cloud  of  radius  R  with  the 
source  at  the  center.  Since  there  is  no  absorption,  clearly  the  power  leaving  the  cloud  at  steady  state  is  P, 
which  is  uniformly  distributed  over  the  surface.  Assuming  a  speckle  spot  radius  of  A/2,  the  power  per 
speckle  at  distance  R  is  fts(ft)  =  PA2/16R2.  Take  a  ft=70W  laser  or  1020  photons/s  (most  lasers  are  of 
that  order),  to  do  any  useful  wavefront  control,  we  need  to  detect  some  minimum  power  above  detection 
noise,  say  1  photon/s  per  speckle,  so  must  have  ft<109  A  or  R~  1  km.  A  more  realistic  requirement  of  104 
photons/s  per  speckle  will  reduce  the  distance  to  ~100m. 

3.1.2.  Requirements  on  Coherence 

We  consider  the  source  coherence  requirements,  for  the  spherical  cloud  picture  under  the 
assumption  that  the  medium  is  perfectly  stationary.  The  centrally  located  light  reaches  the  surface  at 
radius  R  after  reverberating  through  the  medium.  The  shortest  path  is  R,  but  the  average  distance  travelled 
by  a  photon  is  R2 /l* ,  which  is  also  approximately  the  spread  in  arrival  times.  In  order  to  obtain  a  stable 
speckle  pattern  with  high  visibility,  the  coherence  length  has  to  be  of  that  order.  Taking  R=  I  km,  and  1 
=  10  m,  (i.e.,  assuming  100  scattering  lengths)  will  require  a  coherence  length  of  100  km,  that  is,  the 
spectral  width  of  the  laser  must  be  below  ~10  kHz,  and  the  result  is  100kHz  for  ft  =  100m.  This  is  not  your 
everyday  laser.  Note  also  that  if  the  goal  is  to  establish  a  communication  link  between  the  source  and  the 
detector,  the  information  (modulation)  rate  needs  to  be  lower  than  these  rates  to  preserve  coherence. 

The  diffusion  model  provides  valuable  information  about  the  coherence  requirements  for  a  laser 
to  penetrate  a  scattering  medium  and  produce  speckle  [Mck2000].  Monochromatic  light  forms  speckle 
with  the  contrast  ration  of  unity  regardless  of  the  amount  of  scatter,  but  even  very  coherent  laser  sources 
may  have  coherence  lengths  on  the  order  of  hundreds  of  meters.  Control  of  coherence  can  be  used  as  a 
basis  for  imaging  [Mck2000].  More  relevant  in  appraising  the  degree  of  scatter  that  can  be  accessed  is  the 
source  coherence  requirement  from  the  diffusion  model.  The  normalized  p(t)  is  the  travel  time 
distribution,  and  transformation  to  length  gives  the  path  length  density  function,  p(l).  The  width  of  p(t), 
say  measured  by  ert,  indicates  a  measure  of  the  laser  coherence,  so  the  bandwidth  of  the  light  source 
should  satisfy  BW  <-l/at.  Clearly,  coherent  communication  through  increasing  scatter  requires  an 
increasingly  coherent  source. 

3.1.3.  Absorption 

The  estimations  in  Sections  3.1.1  and  3.1.2  assume  that  the  medium  is  perfectly  transparent. 
However,  even  weak  absorption  can  be  significant  because  the  light  effectively  travels  a  much  longer 
distance  than  the  physical  distance.  Light  at  1  micron  loses  about  50%  in  3  km  to  water  vapor  absoiption 
in  air  (probably  much  more  inside  a  cloud);  hence,  there  will  be  practically  no  light  emerging  from  a  1  km 
cloud  at  this  wavelength.  At  100  m  (and  ~10  km  effective  travel  per  photon),  the  transmission  would  be 
-10%.  However,  we  note  that  the  absorption  loss  is  much  less  drastic  for  light  at  400nm  -  absorption  is  3 
orders  of  magnitude  lower.  The  transmission  would  be  commensurately  improved  at  the  shorter 
wavelength.  This  exercise  emphasizes  the  need  to  tailor  the  wavelength  to  the  vicinity  of  400  nm  if 
absorption  is  expected  to  have  a  large  negative  impact.  The  interplay  between  scattering,  absorption  and 
wavelength  choice  is  an  interesting  one.  We  can  see  here  that  a  shorter  optical  wavelength  is  favored  for 
absorption  considerations,  while  a  longer  wavelength  is  desired  for  minimizing  scattering.  The  exact 
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choice  of  wavelength  is  dependent  on  the  scenario  in  consideration.  For  example,  in  aerial  surveillance,  a 
shorter  wavelength  is  likely  desirable  to  minimize  the  substantial  absorption  associated  with  the  long 
distances.  For  medical  applications,  longer  wavelengths  to  minimize  scattering  is  likely  more  desirable. 

3.1.4.  Dynamics 

To  perform  coherent  wavefront  shaping  in  a  dynamic  medium,  the  measurement  system  has  to  be 
faster  than  the  fluctuating  speckles.  If  the  speckle  pattern  is  changing  at  a  kHz  rate,  a  satisfactory  number 
of  photons  must  be  measured  in  1  ms,  and  really  much  faster  in  order  to  use  the  information  to  control  the 
system  before  the  pattern  changes.  This  will  reduce  the  above  maximal  distances  to  -100  m  (to  detect  just 
one  photon,  and  -10  m  allowing  a  larger  dynamic  range). 

3.1.5.  Detector  Noise 

Detector  shot  noise  (due  to  randomness  in  the  arrival  of  photons  or  the  generation  of  charge  in  the 
detector)  and  thermal  noise  (due  to  the  physical  temperature  of  the  detector,  or  in  the  equivalent  sense, 
due  to  the  environment  noise  at  the  detector,  along  with  the  signal)  limits  all  communication  and  imaging 
systems.  The  detector  noise  therefore  dictates  source  energy,  for  an  active  system,  and  integration  time  or 
detector  bandwidth.  In  turn,  the  detector  speed  dictates  the  possible  dynamic  media.  The  SNR  can  be 
calculated  as  pf  /of,  where  /q  and  of  are  the  photocurrent  mean  and  variance  induced  at  the  detector  by 
the  incident  photons.  The  mean  and  variance  can  be  approximated  as  /q  =  e]r\  and  of  =  2epiB  + 
(4kBTB)/R  for  shot  and  thermal  noise,  respectively,  where  e  is  the  charge  of  an  electron,  T]  is  the 
detector  quantum  efficiency,  /  is  the  photon  current  or  power  detected,  B  is  the  detector  bandwidth,  kB  is 
Boltzmann’s  constant,  T  is  temperature,  and  R  is  the  effective  static  resistance  of  the  detector.  Here,  the 
2epiB  term  in  the  variance  reperesents  shot  noise,  and  the  (4 kbTB)/R  term  gives  the  thermal  noise.  This 
simple  picture  provides  a  design  budget  for  communication  in  randomly  scattering  media. 

3.1.6.  Scaling  of  Scatter 

To  obtain  the  scattering  mean  free  path,  -£s  =  l/(pos),  we  need  the  scattering  cross  section  of  a 
single  scatterer,  os,  and  the  density  of  scatterers,  p.  For  water  droplets,  the  scattering  cross  section  has 
been  shown  to  be  comparable  to  the  geometrical  cross  section  over  a  wide  range  of  radii  [Houl949]. 
Assuming  that  the  radius  of  water  droplets  is  1  pm  and  using  a  relatively  low  density  of  109  m'3,  the 
scattering  mean  free  path  is  found  to  be  1  km.  A  diffusion  model  would  hold  for  scattering  medium 
thicknesses  more  then  several  km.  The  parameters  describing  the  scattering  medium  can  be  scaled  by  a 
(on  the  order  of  105  for  scaling  laboratory  distance  to  large  distance,  or  10  5  for  scaling  the  large  distance 
to  laboratory  distance),  resulting  in  f  =  ar,  c  =  ac,pa  =  pa/a,  ps  =  ps/a,  and  g  =  g.  Note  that  the 
distances  between  scattering  and  absorption  events  ( ls  and  la)  are  scaled  by  a  factor  of  a.  This  scaling 
allows  a  material  with  widely-spaced  scatterers  to  be  modeled  by  a  more  densely  packed  material  (in  the 
lab).  The  scaling  of  the  velocity  requires  the  scaling  of  the  refractive  index,  however,  the  velocity  is  not 
needed  in  the  case  of  unmodulated  light  (cu  =  0).  Additionally,  in  the  case  where  there  is  no  or  little 
absorption,  the  scaling  can  be  written  as  g  =  g,  p.s  =  ps/(a)2,  and  c  =  c,  where  the  scaling  of  the 
velocity  is  absorbed  by  the  scattering  coefficient.  Without  velocity  scaling  and  with  absorption,  both  the 
time  and  transmittance  are  scaled  by  a  factor  of  a.  In  this  case  if  we  integrate  over  time  to  find  energy,  we 
find  that  in  the  condensed  medium  the  output  energy  is  increased  by  a  factor  of  1/a  =  10s,  meaning  the 
detected  power  through  a  condensed  medium  can  be  directly  related  to  the  detected  power  through  a 
cloud,  even  without  velocity  scaling. 
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3.2.  Source  and  Detector  Configurations  -  Space,  Time,  and  Frequency 
3.2.1.  Spatial  Extent  and  Degrees  of  Freedom 


With  coherent  light,  whereby  speckle  occurs,  the  phase  and  amplitude  of  incident  light  can  be 
controlled  as  a  function  of  position  (or  equivalent  signal  processing  applied,  yielding  spatial  diversity  or 
MIMO,  and  perhaps  incorporating  spectral  diversity),  there  are  opportunities  to  extend  the  penetration 
depth  beyond  that  suggested  by  a  statistical  average  picture.  If  the  medium  can  be  considered  stationary 
for  a  suitably  long  period  for  the  field  Green's  function,  of  the  governing  partial  differential  equation  for 
the  light  fields,  or  the  transmission  matrix  or  scattering  matrix  for  modes,  to  be  determined  as  a  function 
of  frequency,  then  focusing  light  through  arbitrary  scatter  is  in  principle  possible,  provided  absorptive 
loss  is  negligible.  The  efficacy  would  then  be  limited  by  the  spatial  support  of  the  optical  control,  by  the 
degrees  of  freedom  (pixilation),  and  by  other  practical  issues  such  as  the  need  to  control  light  with  lenses 
and  mirrors.  While  overall  scattering  loss  may  increase  with  degree  of  scatter,  reducing  the  energy  in  the 
focus  (because  of  backscattering),  with  certain  arrangements  and  separate  control,  special  matching  may 
be  possible  that  would  ideally  allow  most  of  the  ‘signal’  to  be  coupled  to  the  focus.  The  primary 
limitation  is  then  the  required  measurement  speed,  dictated  by  the  velocity  (distribution)  of  the  scatters, 
and  of  course  the  detector  SNR,  again  with  performance  dictated  by  the  technology.  By  exploiting 
information  related  to  (natural)  motion  of  a  source  or  object,  requirements  to  characterize  the  scattering 
medium  could  be  relaxed  and  the  communication  or  imaging  problem  simplified.  Information  measures 
may  provide  guidance  on  necessary  data  and  ways  to  quickly  process  or  interpret  scene  or  sensory  data. 

3.2.2.  Control  of  Energy  Transport  Through  Scattering  Media 


While  control  of  the  fields  (sources)  over  a  closed  boundary  coupled  with  knowledge  of  the  Green’s 
function  for  the  scattering  domain  precisely  specifies  the  fields  at  all  points  inside  or  outside  the  closed 
boundary,  the  ability  to  couple  energy  used  to  set  up  those  sources  is  a  separate  question.  Furthermore, 
while  necklace  states  that  exist  in  strongly  scattering  media  that  exhibit  Anderson  localization  provide 
energy  transport  channels,  it  seems  unlikely  that  these  will  be  significant  in  the  more  weakly  scattering 
(with  heavy  overall  scatter)  media  that  are  most  common  in  nature. 

Consider  M  propagating  modes  in  a  waveguide  that  has  a  region  containing  random  scatterers. 
Control  of  the  M  incident  mode  complex  coefficients  could  control  the  mode  coefficients  on  the 
transmission  side.  Separate  would  be  the  question  of  reducing  the  reflection  coefficient  for  all  incident 
modes  to  zero,  i.e.,  of  coupling  all  of  the  incident  energy  through  the  random  medium.  This  would  require 
more  degrees  of  freedom  in  the  incident  field.  This  could  occur  by  having  two  different  waveguides  or 
otherwise  allowing  control  of  M  incident  modes  to  influence  N  modes  at  the  region  on  interest,  where  M 
>  N.  We  can  extend  this  idea  to  scattering  media  in  unbounded  space,  where  M  pixels  or  spatial  modes 
are  used  to  control  N  basis  functions  (modes,  for  instance)  at  the  object/receiver/position  of  interest.  The 
control  of  energy  delivered  to  the  region  of  interest  is  proportional  to  (M+N/)N  ~  M/N for  M  »  N. 

Energy  delivery  can  therefore  be  impacted  by  wavefront  control.  The  number  of  control  elements  in 
relation  to  the  degrees  of  freedom  at  the  region  of  interest  dictates  the  fraction  of  the  incident  energy  that 
can  be  delivered.  For  discussion  of  this  picture,  refer  to  Sections  2.3  and  2.4.2. 


3.2.3.  Source  and  Detector  Arrangements  -  Spatial  Diversity 

One  of  the  important  applications  of  wavefront  shaping  lies  in  imaging  through  biological  tissue. 
Moving  an  ultrasound  focus,  for  instance,  allows  light  intensity  at  different  position  within  the  tissue  to  be 
sampled.  The  memory  effect  [Fre88]  is  also  utilized  to  shift  the  optical  focus  behind  the  scattering 
medium  [Kat2014b].  However,  such  scanning  methods  require  a  guide  star  and  are  typically  slow.  To 
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overcome  such  problems,  a  convolution  between  the  fluorescent  object  and  the  speckle  field  that  excited 
the  fluorophore,  shifted  using  the  memory  effect,  was  employed  [Ber2012].  A  Gerchberg-Saxton-type 
iterative  algorithm  was  then  applied  to  reconstruct  the  object  behind  the  scattering  layer.  This  imaging 
technique  was  soon  applied  to  image  blood  cells  beneath  chicken  skin  [Yanl4].  Instead  of  shifting  the 
excitation  field,  Katz  et  al.  [Kat2014b]  calculated  the  autocorrelation  of  the  object  with  just  a  single  shot 
of  the  camera.  The  researchers  successfully  reconstructed  the  image  of  the  objects  behind  a  0.5  mm  thick 
chicken  tissue  using  the  same  phase  retrieval  algorithm.  Interestingly,  Katz’s  method  does  not  need  to 
actively  shape  the  wavefront;  instead,  the  object  itself  shifts  the  speckle  (point  spread  function)  on  the 
camera  plane. 

Correlations  over  source  position  with  distance  steps  large  relative  to  the  wavelength  provide 
information  about  the  fields  incident  on  a  randomly  scattering  medium,  in  principle  regardless  of  the 
degree  of  scatter  [New2012,  New2014b]  and  distinct  from  the  memory  effect  [Fenl988,  Berl989]]. 
Figure  9  shows  recent  efforts  from  the  Webb  group  that  allowed  the  field  incident  through  two  apertures 
to  be  determined  from  speckle  images  on  the  other  side  of  a  heavily  scattering  medium.  This  result  will 
open  avenues  for  communication,  imaging,  and  control  through  heavily  scattering  media  and  may 
facilitate  determination  of  the  transmission  matrix  or  Green’s  function. 

We  outline  the  mathematical  basis.  Consider  a  Green's  function  representation  to  describe  the 
(polarization-dependent)  speckle  field  correlation  [Wan2010,  New2012], 


(E[U(r)\E*[U(r  +  Ar)]>  =  fr,  U(r';r)U*  (r'  +  Ar;r)(|G(rd,r')l2)dV, 
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where  rd  is  the  detector  position,  r  is  the  object  (source)  position,  A r  is  the  translation  vector,  U  is  the 
field  incident  on  the  scattering  medium ,  E  is  the  field  scattered  from  the  random  medium  at  the  detector, 
and  G  is  the  field  Green's  function  that  is  averaged  over  scatterer  configurations.  In  the  limit  of  sufficient 
scatter,  the  Green's  function  term  is  reduced  to  a  constant  and  the  correlation  can  be  rewritten  using  a 
plane  wave  superposition  as 

(I[U (r)]I[U (r  +  Ar)]>  *  |:F-1{|t4(fc||)|2}|2,  °9) 

where  T  represents  the  Fourier  transform.  Remarkably,  the  field  incident  on  a  scattering  medium  can  be 
reconstructed  by  measuring  the  resulting  intensity  speckle  images  (Figure  9(b)). 


Figure  9:  (a)  Illustration  of  imaging  through  thick  scattering  media.  Intensity  speckle  images,  collected  over  object 
position,  are  used  to  reconstruct  the  field  from  a  laser-illuminated  object  that  is  incident  on  a  randomly  scattering 
medium.  The  red  circle  in  the  speckle  images  shows  how  the  speckle  image  evolves  as  the  object  moves,  (b) 
Reconstruction  using  our  speckle  imaging  method  showing  the  magnitude  of  the  field  shaped  by  a  two-hole 
aperture.  The  shaped  laser  beam  was  incident  on  a  9~mm  thick  slab  with  fi's  =  4  cm'1.  For  details,  see  [New2014b]. 
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3.3.  Decorrelation  Time  and  Scatterer  Velocity  Density  Functions 
3.3.1.  Physical  Media 


Physical  scattering  systems  move,  and  this  motion  presents  challenges  for  optical  instruments. 
Examples  are  aerosols,  turbid  water,  and  biological  tissue.  The  velocity  distribution  of  the  scatterers 
becomes  an  important  measure  that  will  drive  certain  technologies  and  pose  limits  on  approaches.  Using 
an  optical  measure,  the  decorrelation  time  of  speckle  patterns  provide  characteristic  information  about  the 
dynamic  scattering  medium  and  also  a  metric  for  detector  integration  time.  In  addition,  the  sources  and 
detectors  may  be  moving.  While  substantial  use  of  the  decorrelation  of  speckle  patterns  has  been  used  in 
biological  applications,  diffuse  wave  spectroscopy  (DWS)  for  instance  [Pinl988],  there  is  a  dearth  of  data 
related  to  various  dynamic  media  that  could  be  of  interest.  Such  media  may  have  velocity  density 
functions  that  are  quite  complex,  with  various  regions  having  different  characteristics  -  associated  with 
vortices,  for  instance.  We  suggest  efforts  to  characterize  dynamic  media  would  produce  useful  data  for 
coherent  communication  and  control  work,  which  would  also  drive  measurement  time  scales  and  the 
associated  technology  requirements. 

Using  wavelengths  within  atmospheric  windows,  communication  signals  propagating  through  the 
air  are  subject  to  the  attenuation  due  to  the  absorption  and  scattering  by  natural  or  anthropogenic  aerosols 
[Col2007,  Hin2012].  To  model  scattering  environment  relevant  to  application,  the  dynamic  scattering  by 
various  types  of  aerosols  (sulphate,  dust,  rain,  fog,  and  cloud)  under  different  situations  (e.g.,  wind  speed, 
temperature,  humidity)  must  be  studied  in  detail.  Substantial  work  has  been  done  to  characterize  the 
aerosol  optical  properties  in  relation  to  the  aforementioned  factors  [Well977,  Hopl990,  Dowl993, 
Mell994,  Hessl998,  Mel2001],  and  to  remotely  sense  the  optical  properties  of  static  aerosols  over  oceans 
[Tanl997].  In  vivo  tissues  are  highly  dynamic  and  relevant  time  constants  have  been  used  in  imaging  with 
speckle  [Boal995].  Despite  these  efforts,  progress  in  any  particular  application  will  rely  on  data  specific 
to  that  situation. 

Can  a  subset  of  the  scatterers  be  involved  in  communication  that  are  moving  more  slowly?  If  so, 
this  could  facilitate  coherent  imaging. 


3.3.2.  Simple  Models 


In  an  ideal  gas,  the  particles'  velocity  is  well  described  by  the  Maxwell-Boltzmann  velocity 
distribution  [Rei965],  which  gives  the  statistical  velocity  distribution  of  freely  moving  particles 
undergoing  elastic  collisions  at  or  near  thermodynamic  equilibrium,  resulting  in  the  density  function 
[Hin2012] 
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where  v  is  the  velocity  of  a  particle,  m  is  the  particle  mass,  k  is  Boltzmann's  constant  (1.38x10  23 
and  T  is  the  temperature  in  Kelvin.  The  mean  velocity  is  [Hin2012] 
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If  we  assume  an  average  particle  mass  of  6.5xl0_14kg,  corresponding  to  micrometer  sized 
particles,  and  a  temperature  of  273  K,  the  mean  velocity  is  3.4xl0-4  J/K  m/s.  This  gives  around  2.9  ms 
before  the  particles,  on  average,  have  moved  about  a  wavelength  (1  pm).  Within  this  time  interval, 
speckle  images  can  be  collected  and  the  primary  contributions  to  the  spatial  correlation  can  be  attributed 
to  the  movement  of  an  embedded  object. 

In  another  model,  aerosol  particles  can  be  described  by  a  Reynolds  number,  the  ratio  of  inertial  to 
frictional  forces,  a  number  less  than  1.  This  region  is  referred  to  as  the  Stokes  region,  where  Stokes'  law 
states  that  the  drag  force  on  a  particle  can  be  described  as  [Hin2012] 
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where  CDis  the  drag  coefficient,  pg  is  the  density  the  gas  and  vp  is  the  relative  particle  velocity.  When  a 
particle  is  released  in  air,  it  quickly  reaches  its  terminal  settling  velocity,  where  its  drag  force  equals  to  the 
gravitational  force,  [Hin2012] 
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where  pP  is  the  density  of  particles,  dP  is  the  diameter  of  the  particle,  g  is  the  gravitational  field  strength 
and  r|  is  the  dynamic  viscosity  coefficient.  In  a  microscopic  picture,  water  droplets  are  constantly  falling 
at  different  terminal  speeds  according  to  their  mass.  In  warm  clouds  formed  of  water  droplets,  larger 
droplets  fall  at  a  higher  terminal  velocity  due  to  their  larger  drag  force.  The  large  droplets  will  coalesce 
with  smaller  droplets  to  form  even  larger  ones,  triggering  precipitation.  Water  droplets  can  be  categorized 
into  small  cloud  droplets  (1  pm  to  20  pm  in  diameter),  large  cloud  droplets/small  raindrops  (20  pm  to  1 
mm)  and  large  raindrops  [Beal976].  It  has  been  shown  that  terminal  velocities  of  droplets  having  various 
sizes  can  be  modeled.  For  a  cloud  droplet  with  diameter  of  20  pm,  the  terminal  velocity  would  be  around 
0.1  m/s  [Besl950j.  To  test  this,  estimation  can  be  made  based  on  (19).  Assuming  standard  air  pressure 
and  temperature  at  273  K,  the  same  diameter  (20  pm),  the  terminal  velocity  calculated  is  0.0119  m/s, 
which  agrees  with  a  more  sophisticated  model  [Besl950].  In  such  situations,  the  faster  motion  and  shorter 
speckle  measurement  time  window  is  still  feasible. 

3.3.3.  Correlation  Time  Metric 


The  temporal  resemblance  in  speckle  intensity  pattern,  commonly  referred  as  speckle 
autocorrelation  function,  is  used  as  a  conventional  measure  of  scatterer  movement.  Mathematically,  the 
correlation  between  the  speckle  patterns  at  time  t0  and  t0  +  r  can  be  defined  as  [Dur2010] 
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where  /(t)  is  speckle  intensity  at  time  t  and  the  brackets  (  )  denote  the  ensemble  average.  The 
autocorrelation  function  gradually  decays  from  1  to  0  as  the  scatterer  movement  constantly  changes  the 
resultant  speckle  pattern. 

The  temporal  fluctuation  of  the  scattered  light  field  provides  useful  information  about  the 
dynamics  of  a  given  sample  (e.g.,  the  velocity  distribution  and  direction  of  the  scatterers).  For  instance, 
when  the  light  is  scattered  by  a  particle  subject  to  Brownian  random  motion,  g2(j )  exponentially  decays 

with  the  time  constant  1/2 Dq2,  where  D  is  the  particle  diffusion  coefficient  and  q  is  a  scattering  wave 

2  2  2 

vector  magnitude.  For  the  case  of  directional  flow,  g2(r)  equals  e~q  v  T  ,  where  v  is  the  velocity  of  flow 
[Dut-2010]. 

When  the  light  is  multiply  scattered,  as  in  tissue,  g2(r )  varies  with  scattering  path  length.  For  the 
case  of  non-interacting  Brownian  scatterers,  q7( r)  [Marl9871  is  given  by 

fcW  -  e-*K**n*  (25) 

The  quantity  r0  is  a  single  scattering  relaxation  time  defined  by  l/D(2/c0),  where  k0  is  the  free 
space  wave  number,  D  is  the  diffusion  coefficient,  and  l*  is  the  TMFP.  With  multiple  scattering,  g2  (r) 
also  follows  an  exponential  decay  model  but  the  decay  time  constant  is  inversely  proportional  to  the 
scattering  path  length.  More  details  on  the  relevant  theory  are  in  the  literature  [Ber2000,  Dur2010]. 

The  technique,  by  which  useful  information  can  be  inferred  from  the  speckle  autocorrelation  in 
the  multiple  scattering  regime,  is  called  diffusing  wave  spectroscopy  (DWS)  [Pinl988,  Macl989, 
Dur2010].  Many  interesting  aspects  of  tissue  dynamics  have  been  discovered  by  the  use  of  DWS. 

First,  the  motion  of  blood  cells  mainly  contributes  to  the  fast  decay  of  g2(r).  Though  cells  and 
their  organelles  are  moving  in  a  fluidic  environment  of  tissue,  the  extracellular  matrix  (e.g.,  collagens, 
elastic  fibers,  proteoglycans)  mechanically  support  the  cells  so  that  the  movement  is  very  slow  compared 
to  the  motion  of  blood  cells.  For  instance,  the  speed  of  red  blood  cells  in  rat  arteriole  is  1~3  mm/sec  and 
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the  cell  migration  speed  of  a  human  cancer  cell  and  T-lymphocytes  in  collagen  matrix  is  around  0. 1-0.3 
and  7-10  um/min,  respectively.  T-lymphocytes  are  known  as  highly  motile  cells  as  it  use  a  cell-adhesion 
receptor  for  its  migration  towards  foreign  antigen  while  the  cancer  cells  destructively  migrate  through  the 
extracellular  matrix. 

Second,  g2(r)  fits  well  with  the  Brownian  model  of  scatterer  movement  over  a  wide  range  tissue 
types,  such  as  rat  brain  and  human  muscle.  This  is  a  reasonable  result  considering  that  the  motion  of 
blood  cell  is  not  ballistic  inside  the  microvasculature  (e.g.,  capillaries,  arterioles,  and  venules).  Though 
the  blood  flow  in  the  main  arteries  and  veins  is  ballistic,  light  is  mostly  absorbed  when  it  propagates 
through  the  main  blood  vessels. 

Third,  the  g2(r )  decay  time  constant  has  a  range  from  several  microseconds  to  several  seconds, 
depending  on  the  collection  geometry,  sample  thickness,  blood  cell  concentration  and  pressure  applied  on 
the  tissue.  Because  the  collection  geometry  and  sample  thickness  determine  the  distribution  of  path  length 
of  diffused  photons,  it  is  clear  from  (25)  that  the  two  parameters  significantly  affect  the  decay  time.  Blood 
cell  concentration  plays  an  important  role  in  determination  of  the  effective  l*  in  (25).  When  tissues  are 
immobilized  with  some  pressure,  the  motion  of  blood  cell  is  restricted.  In  turn,  g2  (r)  decays  slowly.  One 
example  presenting  fast  dynamics  is  brain  tissue.  In  the  case  that  speckle  fluctuations  from  the  adult 
human  brain  is  measured  in  a  backscattering  geometry,  the  decay  time  is  on  the  order  of  tens  of 
microseconds  [Dur2004].  In  contrast,  a  tightly  clamped  rabbit  ear  presents  a  decay  time  of  a  few  seconds 
[Cui2010a], 

Our  ability  to  perform  wavefront  shaping  depends  on  the  medium  being  stable  during  the  process, 
or  more  specifically  the  stability  of  the  transmission  matrix.  The  transmission  matrix  stability  can  be 
directly  quantified  through  its  transmitted  speckle  correlation.  Ref.  [Jan2015]  details  the  derivation. 
Succinctly  put,  the  efficiency  of  our  wavefront  shaping  ability  can  be  directly  quantified  as 
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PBR(t0 )  ~92[T) 


(/(T)/(t0+T))  _  . 

</(to)>2 


(26) 


where  g2  (r)  is  the  correlation  function  of  the  speckle  intensity  at  time  t  and  t0  +  t.  Equation  (26)  is 
useful  as  it  means  that  we  can  predict  the  performance  of  wavefront  shaping  once  we  determine  the 
speckle  decorrelation  characteristics. 

Now  that  we  have  connected  the  wavefront  shaping  efficiency  to  the  speckle  decorrelation,  we 
can  make  use  of  a  number  of  established  works  to  predict  how  the  wavefront  shaping  efficiency  is  going 
to  be  impacted  by  random  medium  thickness  and  other  medium  characteristics.  Based  on  the  work  of  Pine 
et  al.  [Pin88]  and  Maret  and  Wolf  [Mar87],  the  speckle  field  correlation  gx  (r)  is  given  by 

ST  00  =  (E(t0)E(t0  +  t)*)  «  /0°°  P(s)exp  [-(2t/t 0)(s/l')]ds,  (27) 


where  s  is  the  optical  path  length  within  the  scattering  medium,  1*  is  the  transport  mean  free  path,  t0  is 
the  characteristic  diffuse  time  of  the  scattering  medium,  and  P(s)  is  the  probability  density  function  of 

the  scattering  path  length.  This  equation  shows  that  ^(t)  decays  by  exp  [—  (^")]  per  scattering  step.  The 

first  order  correlation  g1  (r)  and  second  order  correlation  g2(j)  can  be  bridged  using  the  Siegert  relation, 

g2(j)  =  /%iO)|2.  (28) 
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This  set  of  relationships  allows  us  to  make  some  direct  experimentally  based  predictions.  In  Ref. 
[Jan2015],  the  speckle  decorrelation  time  is  experimentally  found  to  be  ~2.5  seconds  for  live  tissue  of 
thickness  1.5  mm  at  a  wavelength  of  532  nm.  Because  the  decorrelation  time  decreases  with  the  square  of 
the  thickness,  this  implies  that  a  wavefront  shaping  system  with  a  response  time  of  10  ms  will  be  able  to 
usefully  work  with  live  tissue  of  24  mm  thickness.  For  a  system  with  a  response  time  of  1  ms,  this 
thickness  limit  increases  to  75  mm.  For  a  measurement  system  with  infinitely  fast  response,  the  light 
transport  time  imposes  a  thickness  limit  of  30  m. 

3.4.  Information  Measures 

How  many  measurements  are  needed  to  construct  a  digital  image?  Naively,  one  expects  a  number 
of  measurements  equal  to  the  number  of  pixels  ( N 2  in  an  NxN  -  pixel  image),  and  this  is  exactly  what 
the  sampling  theorem  from  signal  analysis  predicts  [McK2004].  However,  most  images  have  a 
mathematical  property  known  as  “sparsity”,  whereby  it  is  possible  to  transform  the  image  data  to  a 
representation  that  uses  less  memory  [Cov2006].  An  example  of  a  representation  in  which  most  images 
are  sparse  is  the  wavelet  basis  [Daul992].  This  property  is  widely  used  to  compress  pictures  and  movies 
on  the  Internet,  e.g.,  in  the  jpeg2000  format,  and  is  even  included  in  many  cameras  so  that  most  of  the 
measured  image  data  are  discarded  even  before  storing.  With  regard  to  light  in  randomly  scattering 
media,  mutual  information  [Cov2006]  addresses  the  question  of  the  additional  information  provided  by, 
for  example,  spatial  or  spectral  diversity. 

Compressive  sensing  (for  reviews  see,  e.g.,  [Can2008,  Dav2012])  introduces  compression  already 
in  the  measurement  process  [Can2006,  Don2006,  Dua2008].  Much  of  the  data  that  would  be  discarded  in 
compression  is  never  even  measured,  leading  to  a  speed-up  that  is  especially  important  in  scanning 
imaging  methods  where  a  single  detector  is  used  instead  of  an  array.  In  compressive  sensing,  the 
intensities  of  combinations  or  groups  of  image  points  are  measured  instead  of  single  image  points,  as 
illustrated  in  Figure  10.  Surprisingly,  this  works  very  well  especially  if  the  sensing  configurations  are 
pseudo-random  and  not  related  to  the  image.  Data  processing  is  then  used  to  synthesize  an  image  from  the 
measurements.  As  important  examples,  metamaterials  can  produce  sub-wavelength  sampling  patterns 
[Hun2013]  and  even  random  speckle  is  an  excellent  basis  for  compressive  imaging  [Kat2009,  Car2009, 
Liu2014,  Jan2014,  Taj2014], 
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Cartoon  by  A.P.  Mosk,  2014.  Image:  Portrait  of  Julie  Manet  by  A.  Renoir  (1894),  Musee  Marmottan  Monet,  Paris. 


Figure  10:  Cartoon  of  compressive  imaging:  (a)  In  conventional  imaging  one  probes  an  image  pixel-by-pixel  to 
construct  a  digital  representation.  The  number  of  probes  is  N2  for  an  NxN  -pixel  image,  (b)  In  compressive  ima¬ 
ging  one  probes  the  average  intensity  of  collections  of  pixels.  An  algorithm  optimizes  sparseness  to  obtain  an  ima- 
ge  of  equal  quality  from  a  much  smaller  number  of  measurements. _ 


3.5.  ‘Bootstrap’  Imaging  Methods 


It  has  been  shown  in  recent  experiments  to  be  possible  to  image  at  high  resolution  and  contrast 
through  media  with  a  known  transmission  matrix.  Current  methods  for  transmission  matrix  measurements 
are  invasive  and  are  not  useful  if  access  to  the  object  side  of  the  medium  is  unavailable.  However,  if  the 
transmission  matrix  of  a  thin  slab  of  scattering  medium  can  be  inferred  form  backscattered  light,  it  may  be 
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possible  for  an  imaging  apparatus  to  perform  a  “bootstrap”  procedure  where  one  first  images  the  first 
layer  (of  order  one  mean  free  path  in  thickness),  and  determines  its  structure.  From  the  structure,  by 
solving  the  wave  equation,  it  is  possible  in  principle  to  obtain  the  transmission  matrix  of  such  a  layer. 
This  involves  rather  heavy  calculations,  as  present  finite-difference  or  finite-element  methods  need  large 
amounts  of  computer  memory  and  processor  time.  Then,  using  the  transmission  matrix  of  the  first  layer,  it 
should  be  possible  to  perform  the  same  procedure  on  the  second  layer,  and  so  on  ad  infinitum. 

For  the  purpose  of  this  document,  we  assume  infinite  computing  power  is  available,  but  in 
practice  this  assumes  enormous  advances  in  software  engineering  and  computing  hardware.  Here,  we 
estimate  in  which  cases  optical  measurements  will  give  the  algorithms  even  in  principle  enough 
information  to  start  such  computations  in  a  meaningful  way. 

The  information  content  of  the  medium  can  be  estimated  using  a  simplified  model  [Skoric2008]. 
In  dense  scattering  media  such  as  tissue,  a  minimum  amount  of  information  is  knowledge  of  the  index  on 
a  grid  with  point  spacing  of  at  maximum  A/2.  Approximating  the  medium  as  a  binary  mixture,  at  least 
one  bit  per  grid  point  is  needed,  leading  to  an  information  density  (entropy)  of  8  bits  per  cubic 
wavelength,  or  about  p  =101()  bits/mm  ’.  As  a  result,  a  channel  of  width  1  mm2  and  depth  L  will  contain  an 
amount  of  information  of  1010  (L/mm)  bits. 

A  laser  of  power  1  W  will  emit  about  1019  photons  per  second.  The  photons  will  spread  sideways 
into  a  cone.  Up  to  a  depth  L,  this  cone  has  a  volume  of  order  L3,  and  an  entropy  of  about  1010  (L/mm)3 
bits.  Assuming  we  need  of  order  1  photon  per  bit,  and  1  in  10  photons  is  usefully  backscattered,  we  need 
to  detect  1011  (L/mm)3  photons.  In  1  s  period  the  maximum  achievable  L  is  therefore  about  400  mm,  and 
in  1  ms  the  maximum  depth  is  40  mm.  These  estimates  are  based  on  information  content  and  apply  to  all 
dense  media.  These  are  information  theory  based  maximum  ranges.  Realistic  bounds  might  be  an  order  of 
magnitude  lower. 

In  conclusion,  in  tissue-like  media  bootstrap  methods  may  provide  useful  imaging  and  the 
possibility  of  wavelength-resolution  focusing  up  to  a  depth  of  40  mm.  This  would  enable  sub-cellular 
resolution  imaging  of  almost  all  human  organs. 

Sparse  media  such  as  aerosols  or  atmospheric  conditions  consist  of  droplets  or  particles  in  air.  To 
microscopically  describe  scattering  in  such  media,  one  does  not  need  a  high-resolution  grid.  Instead,  the 
positions  and  sizes  of  all  particles  in  the  volume  of  interest  should  be  known.  Let  us  assume  a  dense  fog 
has  a  density  of  1  particle  per  mm3  [She2010b],  then  the  volume  information  density  is  of  order  100 
bits/mm3.  Assuming  the  same  10%  efficiency  of  back  scattering,  the  number  of  photons  needed  is  103 
(L/mm)3.  In  1  second  the  maximum  L  is  21  m,  in  1  ms  it  will  be  of  order  2.1  m.  Since  this  is  smaller  than 
the  mean  free  path  in  most  fog  conditions,  it  is  to  be  concluded  that  the  use  of  bootstrap-style  methods  in 
aerosols  or  fog  will  be  more  challenging. 

Sandstorm  conditions  contain  particles  at  a  density  much  lower  than  1  particle  per  cubic  mm.  For 
dense  sandstorms  (particle  size  in  the  20  pm  range)  we  find  a  similar  result:  At  a  visibility  in  the  range  of 
a  few  m  there  will  be  1  particle  per  mm3  and  the  same  reasoning  applies. 

For  turbid  water  the  situation  depends  on  the  density  of  particles.  Rain  and  snow,  with  a  much 
lower  number  density  or  much  larger  particles  may  be  more  amenable  to  bootstrap  imaging.  Layered 
media  such  as  plant  and  tree  foliage  or  cloth  are  likely  to  be  quite  amenable  to  bootstrap  imaging  as  the 
scatterers  are  sparsely  distributed  in  space,  however  more  analysis  is  needed  for  the  specific  case. 

An  interesting  speculative  improvement  is  worth  considering:  What  if  it  was  possible  to  confine 
the  probing  light  in  a  narrow  beam?  Such  a  beam  would  need  to  be  confined  by  knowledge  of  the 
scatterer  positions,  hence  would  be  confined  by  scattering  to  a  radius  of  necessarily  about  1  transport 
mean  free  path  l*.  The  amount  of  information  in  the  beam  is  nf  2Lp.  For  a  medium  with  information 
density  p,  incident  photon  flux  <t>  and  measurement  time  t,  we  find  the  maximum  depth  that  can  be 
reached  is 


Counter-intuitively,  the  depth  range  decreases  with  the  mean  free  path  now!  In  a  fog  with  £  =  10  m  the 
maximum  range  for  this  type  of  method  (with  a  1  ms  correlation  time)  now  is  500  m,  which  is  a 
substantial  improvement.  However,  no  path  toward  implementation  of  this  method  currently  exists. 

3.6.  Critical  Factors  in  Wavefront  Control  Speed 


What  is  possible  with  regal'd  to  the  ultimate  scatter  limit  is  fundamentally  dictated  by  detector 
noise.  The  practical  limits  of  scatter  that  can  be  penetrated  are  based  on  the  technology,  with  better 
sources  and  detectors  and  certain  schemes  developed  with  specific  technology  (such  as  what  we  have 
today)  allowing  greater  penetration  of  scatter.  Consider  the  anecdotal  application  in  a  car  where  the 
headlights  are  reflecting  from  fog  without  significant  penetration.  Imagine  headlights  achieved  with  RGB 
lasers  that  electronically  scan  the  road  ahead  and  compensate  the  spatial  distribution  of  the  light  using 
conformable  large  area  control  elements  that  employ  aspects  of  technology  currently  being  developed.  In 
this  way,  the  headlights  compensate  so  that  the  driver  can  see  the  road  ahead.  While  seemingly  a 
challenge  today,  such  a  concept  is  plausible. 

3.7.  Guidestar  Analysis 


This  analysis  is  aimed  at  illustrating  some  of  the  constraints  involved  in  guidestar-based  phase 
conjugation  focusing  of  light  within  a  scattering  medium.  For  simplicity,  we  assume  the  target  sample  to 
be  a  turbid  sphere  (spherical  cloud)  for  which  we  would  like  to  focus  light  at  the  sphere's  center. 

As  a  process,  one  would  first  flood  the  sphere  with  light.  A  guidestar  would  then  be  activated  to 
tag  the  light  traversing  the  sphere's  center.  The  tagged  light  wavefront  would  then  be  detected  at  the 
sphere's  surface.  The  total  exposure  and  collection  time  would  be  x.  A  phase  conjugate  light  field  can  then 
illuminate  the  sample  and  form  a  focus  at  the  sphere's  center.  We  assume  that  the  sphere  is  sufficiently 
turbid  that  speckles  are  fully  developed  and  the  diffusion  approximation  holds.  We  further  assume  that  the 
absorption  coefficent  is  negligible.  The  overriding  limiting  constraint  here  is  the  amount  of  tagged  light 
we  can  harvest  in  the  recording  process.  To  be  able  to  generate  a  adequate  wavefront  for  playback,  we 
require  the  detection  of  M  tagged  photons  on  the  detection  side.  M  is  a  fixed  practical  quantity  and  M  = 
105  is  a  good  benchmark  quantity  for  practical  considerations.  This  gives  us 


M  = 


EshargetAz  ^  f -A  2 
hf  4nr2  \2/ 


(30) 


where  Es  is  the  guidestar  efficiency  (the  fraction  of  photons  tagged  during  interaction),  I,arget  is  the 
irradiance  at  the  target  location,  A  is  the  guidestar  interaction  cross-section,  x  is  the  interaction  time,  (^j  is 

the  speckle  spot  size,  hf  is  the  energy  quantum  of  the  photons  involved,  r  is  the  sample  radius  (or  the 
penetration  depth),  and  N  is  the  number  of  controllable  optical  modes,  x  is  limited  by  the  sample  speckle 
decorrelation  time  because  we  need  to  perform  the  collection  process  in  a  time  shorter  than  the 
decorrelation  time.  For  a  fully  diffusive  medium,  the  decorrelation  time  is  inversely  proportional  to  the 
square  of  the  sample's  lateral  dimension  (or  r).  Taking  this  into  consideration,  we  can  rewrite  (30)  as 


M  = 


EshcirgetAa  jy  AT  2 
hf  4nr4  V2 / 


(31) 


where  a  is  the  decorrelation  time  coefficient. 

As  a  point  of  reference,  living  tissues  with  pulsating  blood  flow  has  a  decorrelation  time  that  is  ~ 
30  ms  for  2  mm  thick  tissue,  which  implies  a  =  1.2x10  7  m2s.  Itarget  is  limited  by  tissue  damage  threshold 
consideration  and  is  nominally  set  at  100  mW/cm2.  N  ultrasound  guidestar  has  an  efficiency  of  ~  0.01.  By 
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substituting  these  realistic  practical  numbers  into  (31),  we  arrive  at  a  relatively  simple  order-of-magnitude 
relationship  for  tissue  depth  penetration  (equals  r )  in  the  context  of  guide-star  based  focusing  as 

r  ~  1  mm  .  IV1/4  (32) 

This  equation  is  interesting  in  that  it  highlights  the  fact  that  one  needs  a  4  orders  of  magnitude  increase  in 
controllable  optical  modes  to  yield  an  order  of  magnitude  increase  in  depth  penetration. 


3.8.  Technology 


Faster  and  more  sensitive  detectors 
will  provide  for  an  increase  in  the  amount 
of  scatter.  There  are  opportunities  with 
improved  single  and  array  detectors  -  the 
noise  (notably  thermal,  to  approach  the  shot 
noise  limit),  read-out  time  for  CCD  cameras 
(which  limit  their  speed),  data  transfer  time 
from  detectors  to  spatial  light  modulators. 

Consider  a  cooled  detector,  to 
reduce  the  thermal  noise,  and  achieved 
performance  with  avalanche  photodiodes 
(APDs)  [Aki2010].  A  typical  measure  is  the 
noise  equivalent  power  (NEP),  which  is  in 
the  range  of  lCT18  -  10 17  W/Hz1/2  for 
commercially  available  APDs  and 
photomultiplier  tubes  (PMTs),  but  can  be  as 
low  as  approximately  10  22  W/Hzl/2  single- 
photon-counting  detection  of  an  APD  operated  at  78  K  [Aki2010].  The  picture  here  is  that  thermal  noise 
dominates.  The  NEP  is  the  light  level  required  to  obtain  a  SNR=1. 

Interestingly,  not  all  wavefront  shaping  methods  can  benefit  from  detector  noise  improvements. 
Methods  that  use  interferometry  to  determine  wavefront  phase  information  can  operate  in  the  shot-noise 
limited  detection  regime  by  simply  using  a  high  power  reference  beam.  Optical  phase  conjugation 
methods  are  almost  all  interferometry  based. 

Data  transfer  from  cameras  to  spatial  light  modulators  is  a  key  limiting  factor  in  experiments 
where  scattering  media  are  dynamic.  To  this  end,  a  fully  integrated  camera  and  spatial  light  modulator 
system  that  is  capable  of  delivering  sub-millisecond  response  time  is  highly  desirable. 

3.9.  Example  Applications  and  Potential 

Some  salient  examples  are  listed  in  this  section.  The  goal  is  not  to  provide  an  exhaustive  list  but  to  show 
by  example  what  is  and  what  may  not  be  possible. 

3.9.1.  Technological  Developments 

Dedicated  phase  conjugation  hardware:  A  dedicated  digitally  controlled  phase  conjugation  device 
(Figure  11)  that:  can  perform  phase  conjugation  of  an  incident  wavefront  with  a  response  time  of  <  100 
ns,  has  1  Gigapixel  resolution  (pixel  size  on  the  order  of  1  micrometer);  and  provides  shot-noise  limited 
phase  resolution  will  have  high  impact.  This  technology  is  a  prerequisite  for  significant  advancements  of 
a  majority  of  methods  and  a  key  enabler  for  several  applications.  Achievement  of  this  is  likely  possible 


Figure  11:  Digital  phase  conjugation  mirror  with  integration 
of  a  photodetector  and  a  phase  modulator. 
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within  a  5  to  10-year  timeframe,  but  requires  significant  and  continued  investment  of  money  and  effort. 
Present-day  technology  can  in  principle  already  enable  this  at  a  lower  pixel  resolution  (megapixel  range) 
and  with  a  response  time  in  the  range  of  a  few  ten’s  of  milliseconds. 

For  a  camera  to  be  suitable  for  DOPC  use,  high  speed  and  high  pixel  count  are  the  two  primary 
consideration  specifications.  Getting  near  shot  noise-limited  detection  is  generally  not  considered  a 
particular  challenge  as  the  wavefront  measurement  process  usually  involves  the  use  of  interferometry,  and 
the  shot  noise  level  detection  can  be  accomplished  as  long  as  the  reference  field  is  sufficiently  strong.  The 
pixel  count  is  currently  in  the  10-100  megapixel  range.  The  bit  depth  of  the  camera  is  relevant  in  most 
applications.  During  interferometry  measurements,  the  signal  we  are  typically  trying  to  discern  is  weak 
and  riding  on  top  of  a  strong  DC  background  (due  to  the  strong  reference  field).  A  large  bit  depth  camera 
ensures  that  we  are  able  to  detect  that  weak  signal.  A  16  bit  camera  is  generally  used,  but  we  really  only 
care  about  the  last  2-4  bits  of  our  measurements.  The  high  bit  count  has  the  unfortunate  downside  of 
creating  a  high  data  volume  download  burden  from  the  camera. 

A  camera  that  has  a  high  number  of  pixels  is  highly  desirable.  A  camera  that  can  output  the 
difference  signal  is  also  highly  desirable.  Such  a  camera  is  within  the  industry’s  technical  ability  to 
implement.  If  one  is  to  manufacture  a  camera  like  this  with  existing  foundries,  the  intrinsic  size  of  the 
silicon  wafer  is  likely  the  current  limiting  factor.  But  suppose  we  use  a  single  wafer  to  create  a  camera, 
and  suppose  the  pixel  size  is  2  microns.  The  maximum  number  of  pixels  we  can  fit  on  the  wafer  is  equal 
(30  cm  /  2  microns)2  =  23  gigapixels,  or  roughly  200-500  times  the  number  of  pixels  in  a  currently 
available  camera. 

An  SLM  optimized  for  OPC  use  should  be  highly  responsive  (matching  camera  speed  if 
possible).  The  number  of  phase  levels  does  not  have  to  be  large;  in  fact,  an  SLM  with  4  levels  would  give 
a  wavefront  shaping  efficiency  that  is  80%  as  good  as  an  SLM  with  an  infinite  number  of  phase  levels 

Thus  far,  we  have  discussed  implementing  OPC  with  the  combination  of  a  camera  and  an  SLM. 
An  integrated  SLM-camera  system,  where  each  SLM  pixel  is  built  on  top  of  the  camera  pixel  (Figure  10), 
is  a  highly  desired  apparatus  that  would  significantly  boost  performance  and  ease-of-use.  Such  a  scheme 
would  eliminate  the  exacting  alignment  demanded  by  the  current  OPC  setup  design.  It  would  also  greatly 
ease  the  task  of  data  transfer  from  the  camera  to  the  SLM,  as  in  this  case  the  data  from  each  camera  pixel 
only  needs  to  travel  to  the  associated  SLM  pixel. 

Path  from  technology  to  imaging  performance:  The  technological  developments  indicated  here  would 
be  extremely  relevant  to  the  stated  goals  for  imaging  in  tissue.  The  imaging  depth  scales  roughly  as 

{N pixels  F)1//4,  where  F  is  the  refresh  rate  of  the  device  and  Npixeis  is  the  number  of  independently 
addressable  phase  pixels.  Therefore,  an  improvement  in  Npixels  F  by  four  orders  of  magnitude  will  gain 
one  order  of  magnitude  in  imaging  depth. 


3.9.2.  Static  Scattering  Material  Properties 

The  following  properties  are  needed  to  specify  a  stationary  random  scattering  medium. 

•  Scattering  mean  free  path  (scattering  coefficient) 

•  Transport  mean  free  path  (related  to  reduced  scattering  coefficient) 

•  Wavelength 

•  Average  (effective)  refractive  index 

•  Absorption  coefficient 

•  Homogeneity  of  the  scattering  properties  (e.g.,  are  there  voids  or  gradients  in  scatterer  density) 

•  Scatterer  size  and  density 

•  Dispersion/  wavelength  dependence  of  transport  properties 
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3.10.  Physical  Limits  on  Phase  Coherent  Methods  in  Scattering  Media 


3.10.1.  Physical  Limits 

In  the  following  we  summarize  in  a  graphical  way  some  of  the  physical  limits  that  must  bound 
the  possible  parameters  where  coherent  techniques  could  be  applied.  The  relevant  parameters  are: 

L  Distance  at  which  the  target  is  located  from  the  source  or  SLM 

Scattering  length  or  mean  free  path  (effective  distance  over 
^  which  light  is  lost  from  a  collimated  beam) 

/*  Transport  mean  free  path  (scattering  mean  free  path  weighted  by 

scattering  angle  -  on  the  order  of  10  4  for  tissue 
To  Characteristic  scatterer  correlation  time  (time  for  scatterer  to 

move  4/2) 

Using  these  parameters  we  can  derive  the  following  parameters. 

Thouless  time  -  the  average  time  it  takes  light  to  reach  the  target  -  tt  =  3  L2 /cl*.  This  is  also  a 
measure  of  the  spread  of  times  over  which  a  short  pulse  will  broaden  on  its  way  to  the  target.  (Note  that 
the  Thouless  time  is  defined  with  slightly  different  numerical  prefactors  in  various  references,  and  the 
assumption  is  made  here  that  the  medium  has  refractive  index  of  approximately  1  and  is  nondispersive.) 

An  estimate  of  the  speckle  correlation  time  -  tsv  =  t0(1* / V)2 
The  following  technical  parameters  are  defined  to  facilitate  presentation  of  the  current  status: 

1.  Processing  time  -  Tp:  the  time  it  takes  for  a  phase  conjugation  system  to  process  a  measured  field 
and  represent  it  as  a  conjugated  field.  Presently,  this  is  several  milliseconds,  but  could 
conceivably  be  reduced  to  the  microsecond  range. 

2.  Guide  star  radius,  for  guide  star  enabled  methods.  For  ultrasound  guide  stars,  this  relates  to  the 
ultrasound  diffraction  limit. 

3.  Guide  star  efficiency,  the  probability  of  a  photon  that  traverses  the  guide  star  volume  to  be 
“tagged”. 

4.  The  number  of  modes  that  an  imaging/wavefront  shaping  system  can  process. 

5.  The  power  of  the  light  source.  From  various  considerations,  we  assume  this  to  be  of  order  1W. 

The  physical  limits  come  from  the  following  basic  requirements: 

1.  SNR  -  the  signal  needs  to  be  adequate  in  one  correlation  time  at  the  target  in  order  to  derive 
correcting  fields.  This  requirement  in  many  practical  situations  of  interest  simplifies  to  “one 
photon  per  speckle  area  per  correlation  time.” 

2.  Stationarity  or  “Round  Trip  Limit”  -  the  scattering  medium  must  remain  unchanged  between  the 
initial  sensing  and  the  delivery  of  the  corrected  field. 

There  are  two  basic  physical  scenarios  that  were  discussed: 

1.  “A  spherical  cloud”,  where  a  source  is  emitting  at  the  center  of  such  a  scattering  cloud  of  radius 
L.  With  no  absorption,  at  steady  state,  the  power  emitted  from  the  surface  of  the  cloud  must  be 
equal  to  the  source  power.  The  number  of  speckles  scales  with  L2/!2  and  the  power  per  speckle 
drops  as  42/L2. 
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2.  “A  slab  cloud”,  where  the  source  is  on  one  side  and  the  target  on  the  other  side  of  a  scattering 
medium.  Here,  some  of  the  light  would  be  reflected  off  the  cloud,  the  total  transmitted  power 
drops  as  l/L  and  hence  the  power  per  speckle  scales  as  X21  */L3. 

Imaging  through  a  scattering  medium  presents  requirements  that  differ  from  those  for  power 
delivery.  The  ability  to  deliver  power  does  not  imply  imaging  is  possible.  Optical  phase  conjugation  and 
wavefront  shaping  are  essentially  methods  for  setting  up  a  power  delivery  channel.  Imaging  could 
involve: 

1.  A  controllable  guidestar,  such  as  an  ultrasound  focus  -  Thus  far,  no  suitable  guidestars  have  been 
created  in  gaseous  media,  however  microwave  heating  and  other  approaches  may  be  plausible. 

2.  The  optical  memory  effect  -  This  means  the  scattering  medium  should  be  no  thicker  than  about 
100  wavelengths. 

3.  Ballistic  or  few-scattered  photons  -  This  only  works  in  the  boundary  layer  of  the  medium, 
typically  up  to  /*. 

4.  Acousto-optics  -  In  this  case,  one  uses  the  light  to  excite  acoustic  waves  that  are  subsequently 
imaged  assuming  they  propagate  ballistically.  This  modality  requires  a  dense  medium  such  as 
water  or  biological  tissue  for  ultrasound  propagation  and  cannot  work  in  air  or  aerosol  media. 

5.  Transmission  matrix  data  -  This  can  only  be  obtained  by  an  invasive  procedure  and  is  usable  only 
within  the  correlation  time. 

6.  Bootstrap  imaging  -  Obtaining  microscopic  data  on  scatterer  positions  from  backscattered  light, 
which  is  subsequently  used  to  calculate  the  transmission  matrix  numerically.  There  has  be  no 
experimental  confirmation  yet  that  this  is  possible. 

7.  Diffusive  optical  tomography  (with  time-dependence)  -  This  method  allows  in  principle  for 
imaging  at  any  depth,  however,  the  resolution  is  dictated  by  the  physics  of  the  model,  the 
measured  data  set,  and  the  computational  imaging  problem.  In  thick  scattering  materials,  the 
resolution  has  been  limited  to  about  depth/4,  as  the  radiative  transfer  equation  that  governs  the 
propagation  of  diffusive  light  exponentially  suppresses  the  waves  that  carry  high-resolution 
information.  Extending  the  resolution/depth  ratio  by  more  than  about  a  factor  of  2  will  be  a 
challenge. 

Figure  12  and  Figure  13  plot  the  appropriate  constraints  on  a  map  of  x  versus  range.  None  of  the 
limits  are  absolute,  e.g.,  the  SNR  limit  is  taken  to  be  SNR=1,  whereas  in  some  cases  a  higher  SNR  may  be 
needed  or  a  lower  SNR  may  be  acceptable.  However,  the  limits  presented  represent  a  cusp  in  the 
difficulty  of  retrieving  information  from  the  system.  All  graphs  were  made  under  the  “spherical  cloud” 
assumptions,  which  are  the  most  prevalent  ones. 

Under  the  assumptions  used,  we  find  that  the  SNR  requirement  of  “one  photon  per  speckle”  can 
be  expressed  asPso^ce  ^  r2  Tsp  >  1,  which  simplifies  to 

Psource  (33) 

hu)  16  n  R4 

The  time-domain  constraint  is  given  by  the  fact  that  the  phase  conjugation  plus  propagation 
processes  must  have  finished  before  the  medium  decorrelates,  i.e.,  the  speckle  correlation  time  must  be 
larger  than  the  Thouless  time  (the  time  for  half  the  photons  to  traverse  the  medium)  plus  the  electronic 
processing  time,  giving 

Tsp  >  r t  +  Tp  (34) 


32 


(35) 


r0((*A)2  >~r  +  Tp. 

Finally,  the  absorption  becomes 
significant  at  the  characteristic  length  on  which 
photons  are  absorbed.  Figure  12  presents  this 
information  for  clouds  and  Figure  13  for  tissue.  In 
Figure  12,  for  biological  tissue  (transport  mean 
free  path  of  1  mm),  we  find  that  the  SNR  limit 
and  the  roundtrip  limit  (assuming  a  10 
microsecond  processing  time)  lie  close  together 
and  the  usable  depth  for  OPC  is  several  cm. 
Assuming  correlation  times  on  the  scale  of  a 
second  (which  may  be  appropriate  for  tissues  with 
no  significant  blood  flow),  it  seems  that  loss  of 
SNR  due  to  absorption  is  the  final  limit.  The 
dashed  red  circle  indicates  the  approximate  range 
of  current  experiments. 

Figure  12  shows  that  in  clouds  and  dense 
fog  (4  =  10  m;  l*  =  100  m),  the  round  trip  limit 
with  an  assumed  electronic  processing  time  of  10 
microseconds  confines  the  range  to  a  few  hundred 
meters.  A  more  important  problem  is  the  loss  of 
SNR,  which  even  for  slowly  moving  droplets 
does  not  allow  a  range  of  more  than  about  100  m. 
In  a  pure  phase  conjugation  setup,  one  may, 
however,  trade  SNR  for  pixel  number,  allowing 
extension  of  the  range  by  decades.  Imaging 
typically  has  more  stringent  SNR  requirements 
than  pure  phase  conjugation.  Opportunities  for 
coherent  control  are  very  good  in  tissue,  due  to 
the  availability  of  good  ultrasound  guide  stars,  the 
low  absorption  in  the  infrared  and  the  surprisingly 
long  correlation  times.  However,  gaseous  media 
present  more  challenges,  due  to:  the  lack  of  a 
demonstrated  guidestar  approach;  the  potentially 
large  size  of  the  media,  making  the  power  per 
speckle  low;  and  the  expected  short  correlation 
time  of  such  media. 

Optical  imaging  methods  using 
incoherent  detection  of  short  pulses  were  shown 
to  be  useful  in  an  “around  the  corner”  imaging 
scenario  and  in  imaging  through  slabs  of  dense 
scattering  materials.  These  methods  have  the 
advantage  of  being  relatively  insensitive  to 
perturbations  in  the  environment  and  can  image 
through  highly  dynamic  media,  but  have  suffered 
from  low  resolution. 

From  Figure  12,  for  clouds  and  fog,  wave 
front  shaping  and  phase  conjugation  have  only 
limited  potential  to  extend  the  depth  range  of 


Limits:  Clouds  and  fog 
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Figure  12:  Physical  limits  on  the  use  of  optical  phase 
conjugation  in  atmospheric  media  such  as  clouds  and 
fog.  The  boundaries  are  relative  to  a  reference  medium 
with  a  scattering  coefficient  of  0.1/m  (scattering  mean 
free  path  of  10  m)  and  a  reduced  scattering  coefficient 
of  0.01/m  (transport  mean  free  path  of  100  m). 
Horizontal  axis:  The  range  in  meters  (on  a  base- 10 
logarithmic  scale) 

Vertical  axis:  The  correlation  time  of  the  medium.  This 
correlation  time  depends  on  the  velocity  of  motion  of 
the  scatterers  and  can  be  very  different  for  media  of 
different  types  or  even  between  different  types  of  fog. 
Orange  (on  some  systems  olive)  area:  Ballistic  zone, 
up  to  one  transport  mean  free  path  in  depth.  In  the 
ballistic  zone  imaging  by  optical  coherence  tomography 
or  related  “gated”  imaging  methods  is  typically 
possible.  In  the  ballistic  zone  speckle  is  partially 
developed.  To  the  right  of  this  area  we  have  fully 
developed  speckle. 

Green  area:  Zone  of  opportunity  for  phase 
conjugation/  wave  front  shaping  methods.  In  this  area 
the  best  possible  signal  to  noise  (based  on  physical 
limits,  not  current  technology)  is  good  enough  to 
successfully  perform  optical  phase  conjugation. 

Blue  area:  Round  trip  allowed  zone.  In  this  zone,  the 
round  trip  time  of  a  light  signal  (including  an  electronic 
processing  time  of  10  microseconds)  is  shorter  than  the 
correlation  time  of  the  medium. 

White  area:  No  realistic  opportunity  for  phase 
conjugation  based  methods  as  the  round  trip  time  (+ 
electronic  processing  time)  for  light  exceeds  the 
correlation  time  of  the  medium. 

Grey  area:  In  this  area  absorption,  even  for  the  best 
choice  of  wavelength,  is  too  strong  to  achieve  imaging 
or  light  delivery  through  phase  conjugation. 
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imaging  methods.  Phase  conjugation  can  extend  the 
depth  range  of  power/signal  delivery  at  depths 
where  conventional  imaging  is  still  possible  but 
light  delivery  becomes  inefficient. 

In  Figure  1 3  we  show  the  physical  limits  of 
optical  phase  conjugation  in  tissue.  The  figure 
contains  the  same  information  as  Figure  12.  In 
tissue  the  range  accessible  to  present  methods  of 
focusing  and  imaging  light  is  less  than  1  mm, 
whereas  optical  phase  conjugation  is  predicted  to 
be  feasible  up  to  a  depth  of  centimeters  in  tissue 
with  a  long  correlation  length. 

Method  by  which  the  figures  in  this  section  were 
determined:  The  detailed  equations  for  the  specific 
lines  in  Figure  12  are  as  follows.  The  line  that 
marks  the  edge  of  the  ballistic  zone  is  L  =  l*  = 
100m.  The  line  that  marks  SNR  =  1  for  phase 
conjugation  (SNR  limit)  is  given  by  (33),  with  the 
photon  flux  corresponding  to  a  power  of  1W, 
P0/(hm)  =  1.6  1019/s.  The  line  that  marks  the 
round  trip  time  limit  is  given  by  (35),  with 
Tv  =  10  ps. 

The  detailed  equations  for  the  specific  lines 
in  Figure  13  are  as  follows:  The  line  that  marks  the 
edge  of  the  ballistic  zone  is  L  =  l*  =  1  mm.  The 
line  that  marks  SNR  =  1  for  phase  conjugation 
(SNR  limit)  is  given  by  (33),  with  the  photon  flux 
corresponding  to  a  power  of  1W,  P0/{ha) )  = 
1.6  1019/s.  The  line  that  marks  the  round  trip  time 
limit  is  given  by  (35),  with  Tp  =  10  [is. 


3.10.2.  Technological  Challenges 

Challenges  motivate  new  technology  that  include: 

1.  Focusing  -  The  development  of  methods  to  facilitate  a  X 12  focus  deep  inside  scattering  media,  or 
even  better  in  the  near"  field. 

2.  Control  of  modes  -  The  experimental  control  of  many  optical  modes  (up  to  100,000  modes  currently). 

3.  Transmission  matrix  -  The  study  of  transmission  matrices  with  significantly  higher  number  of  modes 
than  previously  considered  practical  (>1000). 

4.  Imaging  -  The  idea  of  combining  the  optical  memory  effect  and  phase  retrieval  approaches  to  image  a 
target  behind  an  opaque  screen. 

Specific  needs  in  new  technologies  are: 

1.  Integration  of  the  SLM  with  a  camera  will  circumvent  the  limiting  data  transfer  between  the  SLM 
and  the  camera. 


Limits:  Biological  Tissue 
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Figure  13:  Limits  of  optical  phase  conjugation  in 
tissue  in  the  parameter  space  of  correlation  time  and 
depth  range.  The  reference  medium  is  typical  of  soft 
biological  tissue  with  a  scattering  mean  free  path  of 
0.1  mm  and  a  transport  mean  free  path  of  1  mm.  The 
absorption  coefficient  is  assumed  to  be  0.004/mm, 
which  is  applicable  to  the  near-infrared  region.  Areas 
and  axes  as  in  Figure  3.  The  red  dashed  circle 
represents  current  achievements.  Note  the  substantial 
increase  in  distance  that  is  possible  before 
propagation  time  or  absorption  limits.  The  line  and 
color  codes  are  the  same  as  Figure  12. 
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Much  higher  pixel  count  (upwards  of  100  megapixels)  is  desired  as  it  impacts  on  the  amount  of 
wavefront  details  we  can  render. 

More  phase  levels  is  not  a  priority,  in  comparison  with  a  larger  pixel  count.  Even  with  binary  phase, 
wavefront  shaping  can  be  performed  effectively.  Alternately,  wavefront  shaping  can  be  performed 
with  reasonable  effectiveness  with  simple  on-off  amplitude  control. 

Faster  response  spatial  light  modulators  are 
desirable.  This  will  likely  require  solutions  beyond 
liquid  crystals. 

Alternate  methods  for  mixed  modality  guidestars 
are  desirable. 

Opportunities  on  both  the  physical  and  computational 
fronts  highlight  the  role  of  signal  processing  technology. 

3.11.  Physical  Limits  on  Incoherent 

Imaging  Methods  in  Scattering  Media 

In  this  section,  formulas  and  graphs  are  given  that 
outline  the  physical  limits  of  incoherent  imaging  methods 
in  tenuous  scattering  media  such  as  fog,  turbid  water  and 
snow.  First  we  develop  a  straightforward  model  to  predict 
the  physical  limits  to  the  signal  to  noise  ratio  (SNR)  that 
can  be  obtained  using  several  relevant  methods: 


A.  Traditional  imaging.  The  reference  method,  direct  observation  of  images; 

B.  Digital  contrast  enhancement  of  high-dynamic  range  images; 

C.  Gated  imaging  methods  (OCT  and  time-gated  imaging)  with  digital  processing; 

D.  Time-gated  diffuse  tomography  methods. 

It  should  be  noted  here  that  methods  A  through  C  can  operate  at  any  resolution  of  choice;  one  could 
use  them  to  zoom  in  on  a  high-resolution  license  plate  at  long  range  or  “zoom  out”  to  scan  an  area. 
Method  D  operates  at  a  low  resolution  of  about  depth/5,  and  exponentially  loses  signal  to  noise  at  higher 
depth  to  resolution  ratios. 

The  performance  of  any  method  is  given  in  terms  of  the  maximum  pixel  rate  at  a  SNR  of  1.  For 
useful  imaging  in  most  scenarios  105  pixels/second  with  a  SNR  of  1  is  needed,  e.g.,  to  obtain  a  10  Hz 
frame  rate  of  small  100x100  pixel  frames.  In  all  reference  scenarios  we  assume  a  light  source  of  1W  (1019 
photons/s)  and  to  calculate  the  theoretical  best  performance  we  also  assume  the  best  possible  wavelength 
range  is  chosen  (e.g.,  FFIR  for  imaging  through  fog).  Moreover,  the  reference  target  is  a  Fambertian 
target  with  100%  reflectivity  contrast  (e.g.,  black  text  on  white  paper).  Mirror  or  corner  cube  targets  at  a 
specific  orientation  are  easier  to  image  but  such  cases  are  unrealistic  in  real-world  scenarios. 


Tenuous  media 


N 

X 

0) 

CO 

1— 

~Q) 

X 


108 

107 

106 

105 

104 

1000  - 
0 


2  4  6  8  10  12  14 
Range/mean  free  path 


Figure  14:  Model-based  physical  limits  for 
diffraction-limited  ballistic  imaging  methods  in 
tenuous  scattering  media.  The  vertical 
logarithmic  axis  shows  the  theoretical  best  pixel 
rate  that  can  be  obtained  with  SNR  of  1  in  the 
reference  condition,  versus  range.  Green: 
Reference  method.  Brown:  Digital  contrast 
enhancement.  Blue:  Gated  imaging  methods. 
The  area  where  each  method  has  SNR>1  is 
shaded  in  the  corresponding  color. _ 
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3.11.1.  General  Case:  Incoherent  Imaging  in  Tenuous  Media 

Reference  method:  The  reference  method  (direct  imaging)  can  resolve  objects  up  to  about  1  mean  free 
path  in  depth.  Beyond  this  the  signal  to  background  ratio  drops  below  1.  The  area  where  the  reference 
method  has  a  SNR>1  is  shown  as  green  in  Figure  14  -  Figure  16. 
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Figure  15:  Model-based  physical  limit  of  the 
pixel  rate  for  diffraction-limited  ballistic 
imaging  methods  in  dense  fog  with  a  mean  free 
path  of  10  m.  The  collection  optic  radius  is 
assumed  to  be  25  cm.  Green:  Reference  method. 
Brown:  Digital  contrast  enhancement.  Blue: 
Gated  imaging  methods. _ 


Digital  contrast  enhancement:  In  many  cases  a  digital 
camera  can  capture  a  high-dynamic  range  image,  which 
can  then  be  digitally  processed  to  increase  the  contrast  (by 
e.g.,  Fourier  filtering)  and  thereby  suppress  the  scattered 
light.  This  type  of  contrast  enhancement  depends 
somewhat  on  specific  assumptions  about  the  scattering 
medium,  for  instance  the  scatterer  density  needs  to  be 
homogeneous  or  known.  In  case  of  an  inhomogeneous 
scatterer  density  uncontrollable  artefacts  may  appear  in 
the  image. 

Alternately,  this  analysis  is  also  valid  for 
interferometry-based  image  detection.  This  type  of 
imaging/detection  method  can  reach  shot-noise  level 
sensitivity  by  employing  a  sufficiently  strong  reference 
beam  for  interference.  Moreover,  the  process 
automatically  select  for  detection  only  light  field 
component  that  shares  the  same  coherence  properties  as 
the  reference  beam  -  thereby  allow  the  user  to  suppress 
scatter  light  in  the  detection  process. 

The  best  possible  performance  of  such  a  procedure  can  be  estimated  as  follows:  the  source  flux  is  F 
(photons  per  second),  and  the  number  of  pixels  measured  per  second  (pixel  rate)  is  p.  When  light  is 
reflected  by  a  Lambertian  surface  object  it  spreads  out  over  all  angles  with  an  intensity 

I  (P  P'1  _  ^reflected  cos(d) 

‘lambertianyF,  u )  r2  ’ 

where  9  is  the  angle  between  the  direction  of  propagation 
and  the  surface  normal,  Prefiected  is  the  total 
reflected  power  and  R  is  the  distance  front  the  Lambertian 
reflecting  surface.  As  a  result,  the  geometrical  probability 
to  hit  the  detector  (assuming  a  non-scattering 
environment  and  a  surface  oriented  normal  to  the  line  of 
sight  to  the  detector  so  that  cos(0)  =  1  )  is 
n  r detector / (jtL2)  ■  The  extinction  coefficient  is 
Fext  =  Fs  +  Fa >  which  leads  to  an  additional  round  trip 
loss  for  ballistic  photons  of  exp(— 2  pextL). 

The  detector  is  assumed  to  be  ideal.  The 
illumination  is  assumed  to  be  provided  by  a  beam  aimed 
at  the  object.  This  beam  will  be  scattered  at  a  depth  of 
about  1  transport  mean  free  path  in  the  medium  (/  ),  and 
the  detector  will  pick  up  a  number  of  scattered  photons  of 
order  F 
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Figure  16:  Model-based  physical  limit  of  the 
pixel  rate  for  diffraction-limited  ballistic 
imaging  methods  in  turbid  water  with  a  mean 
free  path  of  0.5  m.  The  collection  optic  radius  is 
assumed  to  be  5  cm.  Green:  Reference  method. 
Brown:  Digital  contrast  enhancement.  Blue: 
Gated  imaging  methods. _ 


hence,  assuming  only  the  inevitable  shot  noise  is  present, 


SNR 


_  f  rdetectoyF\ 

contrastenh  ~  ^  ^2  p  J 


exp/  2  Fext T)  (  F  P detector  ^  ^ 


As  a  result,  the  SNR  is  smaller  than  1  above  the  maximum  pixel  rate 


(37) 
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In  Figure  14  -  Figure  16  we  have  shaded  the  area 
where  SNRcontrastenh  exceeds  1  as  brown. 


Gated  imaging  methods:  In  gated  imaging  methods  the 
light  is  time  gated  so  that  any  scattered  photons  (which 
arrive  at  the  detector  at  the  wrong  time)  are  rejected. 
Streak  cameras  and  other  fast  detectors  can  be  used 
to  implement  time  gating.  Alternately,  this  process 
can  be  easily  accomplished  through  the  use  of  low 
coherence  (temporal)  light  and  interferometry.  The 
main  physical  limitation  is  that  at  great  depth  not  even  a 
single  photon  may  be  detected  within  the  integration  time. 

The  signal  to  noise  ratio  is  SNRgated  = 
F  £  r  e~2^extLT\  here  F  is  the  source  photon  flux,  £  the 
detection  efficiency  (taken  here  as  1  for  an  ideal  detector), 
the  scattering  coefficient  is  p  and  T  =  1/p  is  the  time 
available  to  acquire  a  pixel.  For  the  Lambertian  reflector 
that  is  our  reference  object,  the  effective  reflectivity  is 
R=rdetector/(L2)-  As  a  result  the  theoretical  maximum 
pixel  rate  at  which  SNR>1  is  given  by 


y.  _  '  detectorr 

Fmax; gated  ~  g2  nextL  L2' 


(39) 
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Figure  17:  Model-based  physical  limits  for 
imaging  methods  in  snow  with  a  mean  free  path 
of  0.01  m.  For  the  curves  drawn  here,  the 
collection  optic  is  assumed  to  be  in  contact  with 
the  medium.  For  standoff  operation  one  expects 
a  pixel  rate  that  is  reduced  by  a  factor  of  about 
10000  with  respect  to  the  curves  shown  here. 
Green:  Reference  method.  Brown:  Digital 
contrast  enhancement.  Blue:  Diffuse 

tomography  methods  with  a  target  resolution  of 
20  cm. 


In  Figure  14  we  show  the  general  physical  limits  of  ballistic  imaging  methods  (Contrast 
enhancement  and  gated  imaging)  on  a  normalized  scale.  For  useful  real-time  imaging  the  pixel  rate  must 
be  of  order  105  pixels/second,  e.g.  10  frames  per  second  of  100x100  pixels.  At  such  rates  contrast 
enhancement  methods  are  limited  to  about  6  mean  free  paths  while  gated  imaging  methods  have  the 
potential  to  reach  almost  14  mean  free  paths. 

Method  by  which  the  figures  in  this  section  were  determined:  The  detailed  equations  for  the  specific 
lines  in  Figure  14  are  as  follows.  The  green  line  that  marks  the  edge  of  where  the  reference  method  has 
good  contrast  is  simply  given  by  L  =  1*.  The  brown  line  that  marks  the  edge  of  the  useful  range  of  digital 
contrast  enhancement  is  given  by  SN Rcontrastenh  =  1,  with  SN Rcontrastenh  given  by  (37),  and  assuming 
the  detector  radius  is  very  large,  rdetector  =  1* ,  and  the  photon  flux  corresponds  to  a  power  of  1  W, 
F  =  10 19 /s.  The  blue  line  that  marks  the  edge  of  usefulness  of  gated  imaging  methods  is  given  by  (39), 
with  the  same  parameters. 


3.11.2.  Imaging  in  Fog 

Our  reference  situation  for  fog  is  a  dense  fog  with  a  transport  mean  free  path  (in  the  FLIR  band)  of 
1*  =  10  m.  We  obtain  the  graph  of  Figure  15,  assuming  a  collection  optic  with  a  radius  of  rdetector  = 
0.25  m  (diameter  of  0.5  m,  e.g.,  a  large  Fresnel  lens).  We  assume  an  efficient  and  noiseless  detector, 
which  presently  is  not  available  in  the  FLIR  region.  It  is  at  the  physical  limit  of  gated  imaging  methods  to 
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obtain  imaging  at  the  desired  speed  and  SNR  at  a  depth  of  100  m  in  the  reference  situation,  which 
is  10  times  the  current  state  of  the  art. 

Method  by  which  the  figures  in  this  section  were  determined:  The  detailed  equations  for  the  specific 
lines  in  Figure  15  are  as  follows:  The  green  line  that  marks  the  edge  of  where  the  reference  method  has 
good  contrast  is  simply  given  by  L  =  l*  =  10  m.  The  brown  line  that  marks  the  edge  of  the  useful  range 
of  digital  contrast  enhancement  is  given  by  SNRcontrastenh  =  1,  with  SN Rcontrastenh  given  by  (37),  and 
the  photon  flux  corresponds  to  a  power  of  1  W,  F  =  10 19 /s.  The  blue  line  that  marks  the  edge  of 
usefulness  of  gated  imaging  methods  is  given  by  (39),  with  the  same  parameters. 


3.11.3.  Imaging  in  Turbid  Water 

The  situation  for  imaging  in  turbid  water  is  depicted  in  Figure  16.  In  the  reference  situation  we 
assume  a  mean  free  path  of  l*  =  0.5  m,  and  a  detector  radius  rdetector  =  0.05  m,  all  other  parameters  as 
in  the  previous  figure.  Except  for  the  scale,  the  situation  is  very  similar  to  that  of  dense  fog.  A  range  of 
about  5  m  should  be  achievable  for  blue-green  light  where  the  absorption  is  low. 


3.11.4.  Imaging  in  Snow 


The  reference  scenario  for  imaging  in  snow  is  an  imaging  method  that  can  find  a  buried  object  or 
person  under  1  m  of  snow  with  a  mean  free  path  of  1  cm.  In  this  scenario  image  enhancement  and  even 
gated  imaging  methods  are  of  comparatively  little  value  as  they  can  reach  at  best  about  10  mean  free 
paths.  At  these  depths,  and  with  the  comparatively  low  resolution  needed  for  the  task,  computational 
diffuse  tomography  methods  can  obtain  good  signal  to  noise  and  sufficient  resolution.  The  theoretical 
performance  resulting  from  our  model  is  shown  in  Figure  17.  It  shows  that  even  at  depths  exceeding  lm  a 
useful  imaging  rate  can  be  obtained,  taking  into  account  that  a  pixel  radius  of  0.1  m  (resolution  of  about 
0.2  m)  should  be  acceptable.  As  explained  below,  there  is  even  headroom  for  stand-off  operation,  which 
is  possible  at  the  cost  of  drastically  reducing  the  achievable  pixel  rate. 

In  this  class  of  imaging  method,  an  upper  bound  to  the  signal  is  found  from  considering  the  total 
number  of  photons  that  interact  with  the  object,  followed  by  back-propagation  of  the  information  to  the 
detectors.  The  number  of  photons  that  interact  with  a  resolution  area  on  the  object  is  given  by  the  size  of 
this  area,  nr2es,  multiplied  by  the  diffuse  photon  flux  density  inside  the  medium  at  depth  L,  which  is 

/(L)  =  (^Trl)  (jr) ■  We  assume  here  negligible  absorption.  The  photons  that  interacted  with  the  object 

propagate  back  to  the  detector  side  through  the  medium.  Here,  the  Fourier  components  that  carry  the 
image  information  are  attenuated.  The  information  to  reconstruct  an  image  at  a  resolution  corresponding 

to  spot  radius  rres  is  attenuated  by  a  factor  exp - - — .Assuming  any  detection  background  can  be 

L  2  Tres  J 

sufficiently  removed  by  using  time  gating  or  fluorescence,  the  number  of  signal  photons  available  for 
detection  outside  the  medium  is 


(F\  (nrres\  L 

detectable  =  M  (—7)  exp  [—  — j. 


In  this  ideal  case  the  theoretical  SNR  is  given  by  SNRDiffuse  =  n 


1/2 

detectable 


(40) 

,  and  the  maximum  pixel  rate 


is  given  by 
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In  case  of  detection  at  a  standoff  distance  Lstandoff  from  the  medium,  the  detection  efficiency  is 
reduced  by  a  factor  rdet  /L2stand0ff-  Assuming  a  standoff  distance  of  100  m  and  a  25  cm  optic  radius,  the 
detection  efficiency  is6xl0-6.  The  maximum  achievable  pixel  rate  is  reduced  by  the  same  factor. 
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Therefore  we  conclude  that  even  with  standoff  operation  a  useful  imaging  rate  can  in  principle  be 
achieved  in  the  reference  situation.  The  influence  of  medium  inhomogeneity  such  as  variation  in  the 
packing  density  of  snow  is  not  taken  into  account  here  and  is  a  serious  challenge  for  diffuse  tomography 
methods. 

Method  by  which  the  figures  in  this  section  were  determined:  The  detailed  equations  for  the  specific 
lines  in  Figure  17  are  as  follows.  The  green  line  that  marks  the  edge  of  where  the  reference  method  has 
good  contrast  is  simply  given  by  L  =  /*  =  1  cm.  The  brown  line  that  marks  the  edge  of  the  useful  range 
of  digital  contrast  enhancement  is  given  by  SN Rcontrastenh  =  1,  with  SN Rcontrastenh  given  by  (37),  and 
assuming  the  detector  radius  is  very  large,  rdetector  =  0.1  m,  and  the  photon  flux  corresponds  to  a  power 
of  1  W,  F  =  10 19 /s.  The  blue  line  that  marks  the  edge  of  usefulness  of  gated  imaging  methods  is  given 
by  (41),  with  rres  =  0.1  m,  and  all  other  parameters  as  in  the  other  curves. 


4.  Conclusion 

This  investigation  leads  to  the  following  positions  with  regard  to  opportunities  to  penetrate  more 
scatter  using  light.  A  program  to  develop  fundamentally  new  methods  to  transfer  information  through 
highly  scattering  media  will  allow  an  increase  in  the  range  of  more  than  an  order  of  magnitude.  Rather 
than  exclusively  addressing  a  specific  type  of  scattering  media,  efforts  could  encompass  several  media  of 
practical  relevance  ranging  from  dense  fog  to  biological  tissue,  thereby  addressing  issues  of  fundamental 
and  broad  importance  to  facilitate  a  paradigm  shift.  Success  will  permit  high  resolution  imaging 
throughout  large  portions  of  the  human  body,  the  attainment  of  tactical  information  through  heavily 
scattering  aerosols  (e.g.,  fog,  dust,  and  smoke),  provide  opportunities  to  peer  through  turbid  water,  and 
enable  information  to  be  sent  through  ice  and  snow,  all  in  ways  that  to  date  were  thought  not  to  be 
achievable  but  are  in  fact  within  reach,  based  on  basic  physical  considerations. 

4.1.  Research  Concentration  Areas 

A  critical  core  of  methods  and  technology  are  to  be  developed  for  imaging,  sensing, 
communication  and  energy  delivery  through  media  that  scatter  light.  Detailed  and  quantitative  objectives 
depend  on  the  type  of  medium  under  consideration,  but  consistently  aim  to  extend  the  penetration  depth 
by  an  order  of  magnitude  with  respect  to  the  current  state  of  the  art  while  retaining  task-specific  useful 
resolution,  contrast  and  speed.  While  challenging  and  requiring  technological  and  conceptual 
breakthroughs,  these  objectives  are  in  principle  possible  and  will  not  violate  physical  limits  imposed  by, 
for  example,  detector  signal-to-noise  ratio,  causality  or  information  theory  [2.12,  6.1].  Imaging  is  usually 
the  most  demanding  application,  as  it  may  require  high-resolution  spatial  information  from  a  field  of  view 
as  well  as  scanning,  which  is  not  always  possible.  Sensing,  communication  and  energy  delivery  may  be 
simpler  in  terms  of  spatial  requirements,  but  they  involve  stringent  issues  related  to  response  time, 
efficiency  and  spectral  response. 


4.2.  Key  Physical  Domains  of  Interest 

For  each  of  the  domains  we  present  a  reference  scenario,  with  parameters  that  are  typical  real-life 
situations  where  the  ability  to  view  through  scatter  drastically  improves  safety  or  capabilities.  We  assume 
reference  parameters,  as  the  density  of  media  can  vary  naturally  over  large  bandwidths.  It  is  to  be 
expected  that  imaging  performance  scales  more  or  less  linearly  with  the  mean  free  path,  i.e.,  when  the 
mean  free  path  doubles  one  can  expect  roughly  a  doubling  of  the  useful  range.  Graphs  and  calculations 
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demonstrating  that  the  set  goals  are  within  the  range  of  physical  possibilities,  but  close  to  its  edge,  support 
the  cases. 

•  Tissue 

Imaging  and  delivery  of  optical  energy  through  centimeters  of  human  tissue  is  needed  in  order  to 
optically  locate,  recognize  and  affect  critical  features  such  as  tumors,  lesions  and  foreign  objects  in 
the  body,  and  to  extend  the  reach  of  brain  imaging  in  a  manner  that  will  have  profound  impact  on 
neuroscience. 

As  a  reference  system  we  assume  tissue  with  a  scattering  mean  free  path  of  0. 1  mm  and  a  transport 
mean  free  path  of  1  mm.  The  state  of  the  art  in  such  tissues  is  that  imaging  is  possible  to  a  depth  of 
about  1  mm.  The  specific  goals  in  this  reference  situation  are: 

o  Penetration  depth  of  10  mm  or  more  -  ten  times  the  state  of  the  art  [For  acoustic 
assisted  optical  focusing  in  dead  tissue,  the  current  state  of  the  art  is  able  to  focus  to  a 
point  of  ~30  microns  diameter  at  a  depth  of  2.5  mm  at  a  wavelength  of  530  nrn  with: 
~104  controllable  optical  modes,  an  ultrasound  frequency  of  50  MHz,  and  an 
exposure  time  is  of  -100  ms.  The  exposure  time  is  limited  by  the  decorrelation  time, 
about  30  ms  for  2  mm  of  tissue.] 

o  Resolution  on  the  cellular  scale,  on  the  order  of  10  micron,  enabling  the  recognition 
of  larger  cells 

o  Intrinsic  contrast  or  biocompatible  contrast  agents  suitable  for  use  in  living  tissue 
o  More  than  104  pixels/second  imaging  speed  at  SNR>1  when  imaging  a  biological 
object  at  the  greatest  depth,  but  even  102  pixels/second  will  be  useful  in  some 
situations 

•  Fog  and  aerosols 

Vision,  communication  and  sensing  through  heavy  fog  or  snowstorms  is  sought,  extending  the 
typical  range  from  about  10  meters  to  100  meters  for  safe  driving  or  the  landing  of  (autonomous) 
vehicles.  We  assume  a  reference  situation  where  a  dense  fog  has  a  10  m  mean  free  path  in  the  FLIR 
spectral  region.  State  of  the  art  in  this  case  is  FLIR  imaging,  with  a  range  of  one  mean  free  path.  The 
reference  task  is  recognition  of  an  object  (black  text  on  white  paper)  at  a  resolution  of  10  cm  and  a 
range  of  100m.  The  specific  goals  are: 

o  Penetration  depth  of  100  m,  ten  times  the  state  of  the  art 
o  A  spatial  resolution  that  would  allow  discernment  of  10  cm  objects  at  100  m 
o  More  than  104  pixels/second  imaging  speed  at  SNR>1 

•  Turbid  water 

Imaging  in  order  to  locate  objects  at  a  range  of  distances  in  turbid  (e.g.,  polluted)  water  will 
facilitate  rescue  operations,  the  identification  of  foreign  objects,  and  the  monitoring  of  water 
chemistry  using  light.  Our  reference  system  is  water  containing  scatterers  or  bubbles  leading  to  a 
mean  free  path  of  50  cm.  State  of  the  art  in  this  case  is  imaging  down  to  about  two  mean  free  paths 
using  integral  imaging  with  contrast  enhancement.  The  specific  goals  are: 

o  Penetration  depth  of  more  than  ten  times  the  mean-free  path 
o  Resolution  of  1  cm  at  a  range  of  5  m 

o  More  than  104  pixels/second  imaging  speed  at  SNR>1  when  imaging  a  Lambertian 
object  (e.g.,  black  text  on  white  paper)  at  a  depth  of  10  mean  free  paths 

•  Snow  and  sea  ice 

Vision  through  snow  and  sea  ice  will  be  of  great  value  in  rescue  operations.  Avalanche  snow  has 
a  mean-free-path  of  a  few  mm.  Low  resolution  methods  that  can  remotely  detect  a  person  buried 
under  1  m  of  snow  (several  hundred  mean  free  paths)  would  change  the  way  search  and  rescue 
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operations  are  conducted.  The  reference  scenario  assumes  snow  with  a  scattering  mean  free  path  of  1 
cm  and  negligible  absorption,  and  a  high-contrast  target  (bright  ski  wear).  The  specific  goals  are: 
o  Penetration  depth  of  1  m,  ten  times  the  state  of  the  art 
o  Resolution  of  better  than  20  cm  at  a  depth  of  1  m 

o  More  than  104  pixels/second  imaging  speed  at  SNR>1  when  imaging  a  Lambertian 
object  (e.g.,  black  text  on  white  paper)  at  1  m  depth 


4.3.  Scientific  and  Technological  Domains 

To  enable  the  application  spaces  described  in  Section  D,  revolutionary  progress  in  the  following  domains 
is  sought. 

•  Scattering  medium  characterization 

o  Experimental  data  describing  relevant  (dynamic)  scattering  media 
o  Basic  physical  requirements  for  devices  and  the  limits  on  resulting  imaging  and 
communication  systems 

o  Modeling  and  analysis  for  coherent  methods  in  dynamic  scattering  media 
o  Statistical  and  numerical  methods  for  medium  description  that  provide  for  data 
interpretation 

•  Device  development 

o  Higher  resolution  and  faster  wavefront  modulators  [Current  technology  offers  HDTV 
resolution  at  60  Hz,  and  faster  devices  at  significantly  lower  resolution  (e.g.,  2000 
elements  at  ~50  kHz).  New  devices  should  offer  NF>109,  with  N  controllable 
elements  and  a  refresh  rate  F.  ] 

o  Integration  of  modulators  with  solid  state  cameras,  e.g.,  for  ultrasound-assisted 
methods 

o  Solid-state  cameras  that  combine  high  speed  with  high  pixel  count 
o  Sources  with  suitable  characteristics  such  as  coherence,  spatial  and  spectral  scanning, 
and  wavelength 

•  System  development 

o  Imaging  methods  with  the  potential  for  wavelength  scale  resolution  and  biochemical 
specificity 

o  Coherent  and  incoherent  methods,  including  those  with  mixed  modalities,  for 
communication,  sensing  and  imaging  in  rapidly  changing  media 
o  Methods  to  inject  illumination  light  deeper  into  scattering  media,  including  the 
improvement  of  ultrasound  guidestars  and  methods  to  use  their  signal,  and  the 
development  of  new  and  more  efficient  guidestar  mechanism 
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